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PROGRAMMING  IN  NETWORKS  AKD  GRAPHS 


1.  Introduction 

Hiis  paper  treats  a  certain  class  of  linear  programs,  the  correspond!:: 
graphical  Interpretation,  and  will  bring  together  the  graphical  and 
the  algebraic  approach.  The  first  problem  is  the  network  flow  problem. 

Die  graphical  approach  and  labeling  procedure  are  aue  to  Ford  and 
Fulkerson  (7).  The  earlier  linear  programming  approach  was  given  by 
Dnntzig  [£]. 

In  linear  programing  tne  concept  of  a  basic  solution  to  a  linear 
system  of  equations  and  inequalities  Is  fundamental  since  if  there 
an  optimal  solution  to  a  linear  program,  then  there  ie  an  optimal 
basic  solution.  A  basis  of  a  matrix  A  is  a  matrix  B  consisting  of 
a  — set  of  linearly  independent  columns  of  A,  and  a  ca sin 

solution  to  the  linear  system  Ax  *  b  ,  0  ^  x  ^  O  ,  is  a  solution 

0  0 
x  for  which  there  is  a  basis  R  of  A  such  that  y.t  ■  0  or 

x?  ■  C,  unless  is  a  column  of  B  . 

The  rank  of  a  matrix  A  is  defined  to  be  the  aa  dr.ujn  number  of 
linearly  independent  columns  of  A  .  It  is  a  veil-icr.cwr.  result  of 
linear  algebra  that  the  rank  is  also  equal  to  the  maximum  number  of 
llnemty  independent  raws,  and  that  for  every  set  of  linearly 
independent  columns  of  A  with  fewer  columns  than  the  rank  of  A  , 
other  columns  of  A  car.  ue  added  to  the  set  while  preserving  the 
property  of  linear  independence  until  the  set  nas  as  many  columns  a? 
the  rank  of  A  .  Taus,  a  matrix.  B  of  independent  columns  of  A  is 


2 

a  basis  of  A  if,  and  only  if,  B  has  as  many  columns  as  the  rank  of 
A  ,  or  equivalently  if,  and  only  if,  every  column  of  A  can  be  written 
as  a  linear  combination  of  the  columns  of  B  , 

A  square  m  x  m  matrix  is  defined  to  be  singular  if  its  rank 
is  less  than  m  and  is  non-singular  if  its  rank  is  equal  to  m  . 

Another  well-known  result  from  linear  algebra  is  that  a  system  of 
equations  with  a  square,  non-singular  coefficient  matrix  has  a  unique 
solution. 


2.  Concepts  from  Graph  Theory 
Definitions : 


Graph,  Vertices,  Edges:  A  graph  G  is  a  finite  set  V  of  vertices 

v,  and  a  finite  set  E  of  pairs  of  vertices,  e  *  (v  ,v  )  . 

1  m  k  i  j 

called  edges.  The  edge  e  =  (v  ,v.)  is  said  to  be  incident  to  the 

k  i  J 


vertices  v,  and  v .  . 

i  J 


Network,  Undirected  Graph,  Arcs:  The  edges  can  be  ordered  pairs  or 
unordered  pairs,  and  the  edge  is  correspondingly  called  directed 
or  undirected.  A  directed  graph,  or  network,  is  a  graph  with  all  of 
the  edges  directed.  In  a  network  the  edges  are  called  arcs,  although 
the  term  edge  still  includes  both  the  directed  and  undirected  case. 
Examples  of  directed  graphs  are  transportation  networks  and  communication 
networks.  In  a  transportation  network  the  vertices  are  junctions,  and 
the  arcs  are  connections,  such  as  roads  and  air  routes,  between  junctions. 
An  undirected  connection,  for  example  a  two-way  street,  can  be  replaced 
by  two  directed  edges. 


Subgraph,  Spanning  Subgraph:  A  subgraph  H  of  G  is  a  graph  whose 

A  A 

vertex  set  V  and  edge  set  E  are  subsets  of  V  and  E  ,  respectively. 
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A  spanning  subgraph  H  of  G  is  a  s-tograph  with  the  same  vertex 
set  as  G  . 

Path,  Simple  Path,  Cycle:  A  path  in  a  graph  G  is  a  sequence  of 

vertices  and  edges,  (v.  ,  e  ,  v  ,  e  ,...,v  ,  e  ,  v  ),  such  that 

^'1122  n-1  n-1  n  ' 

e  is  incident  to  both  v  and  v  .  The  vertices  v  ,  v 
i  i  i+1  1  n 

are  called  the  ends  of  the  path  P  ,  and  the  path  is  from  v  to 

v  .  A  simple  path  is  a  path  with  distinct  vertices.  A  cycle  is  a 
n 

simple  path  together  with  an  edge  from  the  beginning  to  the  end  of  the 
path. 

Connected,  Component:  A  connected  graph  is  a  graph  with  at  least  one 
path  between  every  pair  of  vertices,  and  a  graph  which  is  not  connected 
clearly  consists  of  connected  components. 

Tree,  End,  Forest,  Spanning  Forest:  A  tree  is  a  connected  graph 
with  no  cycles,  and  an  end  of  a  tree  is  a  vertex  touching  only  one 
edge  of  the  tree.  A  forest  is  a  graph  consisting  of  one  or  more 
unconnected  trees.  A  spanning  tree  of  a  graph  G  is  a  tree  which  is  a 

spanning  subgraph  of  G  ,  and  a  spanning  forest  of  G  is  a  forest 

which  is  a  spanning  subgraph  of  G  . 

Note  that  all  of  the  definitions  from  path  to  spanning  forest  do  not 
depend  on  whether  any  edges  are  directed  or  undirected. 

Lemma  1  If  there  is  a  path  from  v,  to  v  ,  then  there  is  a  simple 

'  X  K 

path  from  v^  to  v^  . 

Proof:  Let  v, ,  e  v  ,...,v  e  v  be  a  path  from  v  to  v  . 

112  k-1  k  k  lk 

Let  v^  be  the  first  vertex  which  is  repeated,  so  that  v^,...,v^  ^  are 

distinct  and  do  not  appear  again  in  the  path.  Then  suppose  v.  is  the  last 

0 

listing  of  vertex  v^^  in  the  path.  Onit  the  segment  e^  ,  •  •  >ej 

from  the  path  to  form  a  new  path  v^  ,  e^  ,  ,  e  , 


H 


-f  rVe  *  *  vs-  .  )du-  ♦  t.u  :  he  p**h  1?  ;•■.  eated.  eventually  a 
path  will  result. 

Lemma  2  The  folic  wing  is  an  inductive  char  act  erizaticn  of  trees*  a 
tree  1=  either  a  tingl.  -  vertex  or  i=  two  disjoint  trees  joined  ty  a 
single  edge  incident  to  one  vertex  of  one  tree  and  one  vertex  of  the 
other  tree. 

Proof.  Clearly,  ?  graph  constructed  in  such  a  wav  is  a  tree.  Tn  = 
harder  part  cf  the  proof  is  to  show  that  every  tree  satisfies  the 
condition.  If  a  tree  T  has  nc  edge,  then  it  is  e.  single  vertex. 

If  T  has  an  edge,  say  e^  «  (v  ,  v  )  ,  then  there  is  no  simple  path 

between  v.  and  vr  net  using  e  because  if  there  were,  T  would 

contain  a  cycle.  Hence,  by  Lemma  1  there  is  no  path  from  v  tc  vr 

i  ft 

not  using  .  So  if  e  i3  removed  from  T  ,  the  remaining  graph 
has  at  least  two  conne  -.ted  components  I.,  and  T  with  v  in  T, 

-i.  JL  X  -t 

and  Vg  in  .  From,  every  vertex  v  in  T  there  are  simple  paths 

to  v  and  v,  :  therefore,  there  is  a  simple  path  to  v  to  v 

not  containing  e.  .  Hence,  removal  cf  causes  the  remaining  graph 

to  have  exactly  two  connected  components  and  .  They  are 

trees  because  if  either  had.  a  cycle,  sc  would  r  . 

Lemma  5  Every  tree  has  at  -.east  cr*  end,  and  if  it  has  ar.  edge,  then 
it  has  at  least  two  ends. 

Proof:  The  proof  is  most  easily  lore  using  lemma  2.  Lemma  }  is 

true  for  a  single  vertex.  Suppose  it  is  true  for  two  trees.  Then  aiding 
an  edge  incident  to  one  vertex  of  each  tree  will  always  leave  one  end 
in  each  tree.  Hence  the  new  tree  wii_  have  at  least  two  ends,  and  the 


lemma  is  proven. 
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Lemma  4  A  tree  with  m  vertices  has  m-1  edges. 

Proof:  The  proof  is  immediate  using  lemma  2  and  induction  as  in  the 

proof  of  lemma  3. 

Lemma  5  Every  connected  graph  G  contains  a  spanning  tree  T  . 
Proof:  Define  a  subgraph  T  having  the  same  vertex  set  as  G  and 

edge  set  chosen  as  follows.  Initially,  choose  any  edge  of  G  to  be 
in  T  .  Thereafter,  choose  any  edge  of  G  than  doe3  not  produce 
a  cycle  in  T  .  When  every  edge  in  0  -  I  produces  a  cycle  if  added 
to  T  ,  then  T  is  easily  seen  to  be  a  spanning  tree  of  G  . 


3.  The  Linear  Programming  Problem 

For  a  network  G  ,  the  vertex-arc  incidence  matrix  is  defined  by 


r° 

* 

if  arc 

e 

j 

is  not  incident  to 

vertex 

<  i 

if  arc 

=*  (v^>  v)  for  some 

v  €  V 

1 

if  arc 

ej 

*  (v,  V  )  for  some 

v  e  V 

The  linear  programming  problem  is : 

minimize  z  subject  to  Ax4'Js  ,  C^x^a,  O^s^O  , 

cx  +  cs  =»  z 


where  A  is  an  m  x  n  vertex-arc  incidence  matrix  of  a  network  G  , 
and  U  is  an  m  x  n  matrix  such  that  each  column  of  U  has  one  non¬ 
zero  entry  which  is  a  +1  or  a  -1  .  If  a  column  of  U  has  a  +1 


in  row  i  ,  denote  the  variable  by  s,  ,  and  if  a  column  of  U  has  a 
-1  in  row  i  ,  denote  the  variable  by  s  .  Let  a  be  denoted 
correspondingly  c+  or  ,  end  denote  the  corresponding  cost  c  by 

ci  or  Ci  *  Tlle  5i  an<i  s-i  sre  caile<i  S-Lack  variables  or  slacks. 

If  a  variable  x^  was  permitted  to  be  negative,  then  it  could  be 
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replaced  by  two  variables,  its  positive  and  negative  parts,  and  an  arc 
would  be  ad  joined  to  G  in  the  reverse  direction  of  e^  .  If  a  variable 
x.  had  a  lower  bound  £  >  0  and  e  =  (v  ,  v  )  ,  then  b  could 
be  replaced  by  b^  -  £  ,  replaced  by  b^  +  0  ,  0^  replaced  by 

0^  -  P  ,  and  the  lower  bound  replaced  by  0  .  Nothing  is  assumed 
about  b^  being  positive,  negative,  or  zero.  Hence,  0  £  x  £a  , 
a  >  0  ,  is  completely  general  and  includes  lover  bounds  and 


unrestriced  variables.  Symbolically  ,  a,  =*  +  co  means  :io  upper  bound 
is  placed  on  . 

Similarly,  0£s£a,c>0  is  perfectly  general.  A  slack 


must  have  an  upper  or  lower  bound  in  order  to  mean  anything.  A  bound 

can  be  adjusted  to  zero  as  above,  and  then  a  negative  slack  p+ 

can  be  replaced  by  a  non-negative  s^  ,  and  visa  versa.  Note  that  only 

one  of  s^  ,  could  be  present  at  a  given  vertex  v^  .  No  upper 

bound  on  a  slack  is  symbolically  represented  by  *  +  •  . 
th 

The  k  column,  of  A  corresponds  to  arc  e^  of  the  network, 
and  a  column  of  U  with  non- zero  entry  in  row  i  corresponds  to  vertex 


v1  .  The  variable  x^  can  be  thought  of  as  a  fiov  in  arc  e^  , 

the  variable  s+  can  be  thought  of  as  exogenous  flow  out  of  vertex 

v^  ,  and  s^  can  be  thought  of  as  flow  into  vertex  v^  .  The  constraints, 

then,  require  that  the  net  flow  in  vertex  be  b^  . 

0 

Let  A  denote  the  matrix  [A,  UJ  ,  For  a  matrix  B  of  columns 
0 

of  A  ,  let  Fg  be  the  subgraph  of  G  consisting  of  the  vertices 
corresponding  to  columns  of  U  and  edges  corresponding  to  columns 


of  A  together  with  vertices  incident  to  such  edges. 

Theorem  1  If  B  is  a  basis  of  A°  ,  then  FB  is  a  spanning  forest 
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of  G  . 

Proof:  If  F.Q  is  not  a  spanning  subgraph  of  G  ,  then  some  vertex 

B 

of  G  ,  say  vertex  v1  ,  is  not  in  Fg  .  Then, every  entry  in  row  1  of 

0 

B  is  a  zero.  But  some  column  of  A  has  a  non-zero  entry  in  row  1, 
and  such  a  column  cannot  be  written  as  a  linear  combination  of  columns 
of  B  ,  contradicting  B  being  a  basis. 

The  remainder  of  the  proof  consist  of  showing  that  F^  has  no 
cycles.  Suppose  F3  has  a  cycle  \  ^  ,  V*'vk  *  \  *  \+l  “  V1  * 

Then  there  are  k  column'  of  B  ,  say  ,  corresponding  to 


Let 


lf  ej  ■  (vy  Tj*> 
lf  ej  ■  (vj+i'  V  • 


k 

For  v.  not  in  the  cycle  ,  2  b.,y  ■  0  because  none  of  the  arcs 

1  J*L  1J  J 

are  incident  to  v^  so  all  b^  ■  0  for  J  -  l,...,k  . 

For  v^  in  the  cycle,  there  are  four  cases  to  consider: 

(I)  \)  ,  «1+1  -  ("i  ,  v1+1) 

(II)  -  (rt,  viml)  ,  e1+1  -  (Vj,  v1+1) 

(1U)  #1  -  K.l'V  ,  e1+1  .  (v1+1,  vt) 

dv)  «t  ■  (v±,  rw)  ,  e1+1  -  (v1+1,  vt)  . 


r  i  >i 

For  case  (i),  b.  .  ■  S  and  b.  .  ■  0  for  J^i  or  i+1  , 

L  -1  >i+l  1J 


and  yt  -  1,  y1+1  -  1  so 


*  Vj 


j-i 


similar,  and  in  all  of  them 


«  0  ,  The  other  three  cases  are 


zy/- 

j-i  0 


0  contradicting  B 
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having  linearly  independent  columns.  Hence, the  theorem  is  proven. 

The  above  proof  can  be  thought  of  as  picking  a  direction  around 
the  cycle  and  sending  a  flow  of  1  around  in  that  direction.  A  flow 
of  -1  can  be  thought  of  as  reversing  the  direction  of  the  arc  and 
then  sending  a  flow  of  +1. 

A  vertex  corresponding  to  a  column  of  U  in  B  ,  a  basis 
0 

of  A  ,  will  be  called  a  root  of  the  tree  in  Fg  . 

Theory  For  B  a  Basis  of  A0,  .very  trse  of  the  forest  FB 
has  at  most  one  rcot. 


Proof:  Suppose  some  tree  had  two  roots  v^  and  v^  .  A  tree  is 

connected  so  there  is  a  simple  path  from  v^  to  v^  in  the  tree, 
say  v1  ,  e  ,  v2>***>\_i*  \  >  \*  Hence>  there  are  k+1  columns 
of  B  ,  say  B1,...,Blc+2  ,  corresponding  to  e1,  e2, •••>*£>  vi>  \> 
respectively.  Let 


-.1 

if 

3k+1 

has  a  -1 

non- zero  entry 

-hi 

if 

Bk+1 

has  a  +1 

non-zero  entry 

+1 

if 

Bk+£ 

has  a  +1 

non-zero  entry 

if 

Bk+£ 

has  a  -1 

non- zero  entry 

+1 

if 

'  V 

(V’  V 

f  J  «*1,.., ,k 

T 

if 

'j  “ 

Then,  as  in  theorem  1,  I  y.Bd  a  o  ,  contradicting  linear  independence 

M  0 


of  the  columns  of  B.  Hence,  the  theorem  is  true. 

The  construction  above,  as  before,  can  be  thought  of  as  sending 
a  unit  of  flow  into  v1  and  out  of  v^  . 
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A  tree  with  one  root  is  coiled  a  rooted  tree,  and  a  forest  with 
each  tree  having  ore  root  ic  colled  a  rooted  forest. 

A  non-singular,  triangular  natrix  i3  a  square  matrix  with  non-zeros 
on  the  main  diagonal  and  all  zeros  below  the  main  diagonal,  or  which  can 
be  brought  to  such  a  form  by  swapping  rows  and  swapping  columns.  An 
equivalent,  inductive  characterization  is  the  following:  a  square 
matrix  B  is  non-singular,  triangular  if  there  is  a  row  of  B  with  only 
one  non-zero  entry  and  if  the  .matrix  B  formed  from  B  by  deleting 
that  row  and  the  column  containing  the  non-zero  entry  is  also  non-singular, 
triangular.  The  abo/e  characterization  is  complete  if  a  lxl  non- zero 
matrix  is  understood  to  be  non-singular  and  triangular. 

Theorem  3  If  F„  is  a  rooted,  spanning  forest  of  G  ,  then  B  is 

■ _  B 

a  non-singular,  triangular  matrix. 

Proof:  Such  a  matrix  B  vrL.ll  be  square  by  lemma  k,  which  says  a 

tree  has  one  less  edge  than  vertex.  Tne  additional  column  of  U 
for  each  tree  makes  B  have  as  many  columns  as  rows. 

The  proof  is  by  induction  on  c?.  ,  the  number  of  rows  of  fiP  .  For 
m  a  1,  B  is  a  lxl  non- zero  matrix  which  Is  non-singular  and 

triangular.  Assume  the  theorem  is  true  for  1,...,  or  m-1  rows 

0  0 

in  A  for  some  m  j>  2  .  Consider  a  matrix  A  having  m  rows. 

If  B  has  only  columns  from  U  ,  then  B  is  diagonal  so 
certainly  non-singular  and.  triangular.  If  B  has  a  column  from  A  , 
then  F-,  has  an  edge,  and  the  tree  to  which  the  edge  belongs  has 
at  least  two  ends  by  lemma  3.  Bit  the  tree  has  only  one  root,  and 
hence,  there  must  be  a  vertex  vi  which  is  an  end  of  the  tree  and  not 
a  root.  Then,  row  i  of  3  has  only  one  non-zero  entry.  Let  B 
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be  the  matrix  famed  from  3  by  deleting  row  i  and  the  column 

—0  _ 

with  non-zero  entry  in  row  i  .  Let  A  =  [A  ,U]  denote  the  matrix 
0 

formed  from  A  by  deleting  row  i  and  all  columns  with  non-zero 
entries  in  row  i  ,  and  let  G  denote  the  network  formed  from  G 
by  deleting  vertex  v<  and  all  arc3  incident  to  vertex  v^  .  Then 
A  is  the  vertex-arc  incidence  matrix  of  G  ,  and  F—  is  a  spanning 
forest  of  G  .  Furthermore,  every  tree  of  Fr  has  exactly  one 

D 

vertex  corresponding  to  u  in  3  .  Hence,  by  the  induction  hypothesis, 
B  is  non-singular  and  triangular.  Therefore,  B  is  non-singular 
and  triangular,  completing  the  proof. 


Theorem  4 


Let  A  be  such  that  every  connected  component  of  the 


network  G  has  at  least  one  vertex  corresponding  to  a  column  of  U  . 

_  0 

Then  a  matrix  B  of  columns  of  A  is  a  basis  if,  and  only  if,  Fg 
is  a  rooted,  spanning  forest  of  G  . 

Proof:  By  Lemma  S,  each  connected  component  cf  G  contains  a 

A 

spanning  tree.  Let  B  consist  of  the  columns  of  A  corresponding 
to  all  the  edges  in  the  spanning  trees  of  the  connected  components 
of  G  together  with  one  column  from  U  for  each  connected  component 

A 

of  G  .  Then  by  theorem  3  is  non-singular  and  triangular.  Hence, 

0 

the  rank  of  A  is  rr  . 

0 

Suppose  a  matrix  B  of  columns  of  A  has  such  a  corresponding 

graph  F  .  Then  by  theorem  E  is  non-singular  and  triangular. 

Hence,  the  columns  of  3  ore  linearly  independent,  and  B  is  square 

0 

so  has  rc  rows  and  m  columns.  Tnerefcre,  B  is  a  basis  of  A  . 

0 

Suppose  that  E  is  a  basis  of  A  „  From  theorems  1  and  2,  the 
proof  will  be  completed  if  i::  ear.  be  shown  that  every  tree  in  the  forest 
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F  has  at  least  one  root.  Suppose  a  tree  has  no  root.  Then,  B 
B 

has  ra-1  columns  or  less  because  a  tree  has  one  fewer  edge  than 

vertices,  and  no  tree  in  F  can  hav  more  than  one  root.  But  the  rank 

0  0 
of  A  is  m  so  B  could  not  be  a  basis  of  A  .  Hence,  the  theorem 

is  proven. 

Lemma  6  If  B  is  a  m  x  m  non-singular ,  triangular  matrix  of  0  , 

l's  ,  and  -l's  ,  and  if  b  is  a  m  x  1  column  vector  of  integers, 

then  the  solution  to  Bx  ^  b  has  x^  integer  for  j=l,...,m  . 

Proof:  The  usual  iterative  method  of  solving  a  triangular  system  of 

equations  is  to  solve  for  one  variable,  substitute  its  value  in  its 

place  and  move  to  the  right  hand  side.  Then  the  smaller  matrix  B 

will  be  triangular  with  0  ,  1  ,  -1  entries,  and  at  each  step  the 

variable  determined  will  be  an  integer.  The  proof  is  completed. 

Lemma  6  can  be  used  to  show  that  if  b  ,  a  ,  and  ,  a  axe 

integers,  then  every  basic  solution  will  be  integer.  Hence,  if  there  is 

an  optimal  solution,  any  basic  optimal  solution  will  be  all  integers. 

This  property  can  also  be  proven  from  the  algorithm  in  section  L  but  has 

been  indicated  here  tc  complete  the  discussion  of  the  properties  of 

0 

the  matrix  B  when  E  is  a  basis  of  A 


h.  The  Simplex  Method  for  Network  Flows 

In  this  section,  the  simplex  method  for  solution  of  the  network 
flow  problem  will  be  presented  along  with  an  example.  The  algebraic 
details  of  the  simplex  algorithm  with  upper  bounds  and  the  use  of  Rmse  I 
and  Phase  II  in  solving  linear  programs  are  readily  available  [2]  and 
will  not  be  reviewed  here.  However,  a  descriptive  outline  will  be  given 
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as  a  structure  on  which  the  later  algorithms  will  be  built.  The 
simplex  algorithm  begins  with  a  feasible  basis  and  nonbasic  variables 
at  upper  or  lower  bounds. 

Simplex  algorithm 

Step  1 :  Determine  values  of  the  dual  variables. 

Step  2:  Price  out  the  variables  and  select  a  profitable  variable  for 

entry  into  the  basis.  If  there  is  no  profitable  variable,  then  the 
present  solution  is  optimal. 

Step  3-  Determine  the  changes  in  value  of  the  basic  variables  when  the 
new  variable  is  introduced  into  the  basis  with  the  largest  change 
consistent  with  feasibility.  If  there  is  no  limit  to  the  change  in 
the  new  variable,  then  the  objective  function  is  unbounded.  Otherwise, 
go  to  step  4. 

Step  4:  If  the  increase  in  the  new  variable  is  stopped  by  its  reaching 

its  upper  or  lower  bound,  then  it  remains  nonbasic  at  its  upper  or 
lower  bound,  and  the  algorithm  returns  to  step  2.  Otherwise,  enter 
the  new  variable  into  the  basis  and  drop  from  the  basis  one  of  the 
previously  basic  variables  which  prevented  further  change  of  the 
entering  variable.  Def.  ne  a  blocking  variable  to  be  a  basic  variable 
which  becomes  infeasible  if  the  entering  variable  is  changed  any  more. 

Thus,  a  blocking  variable  is  dropped  from  the  basis. 

This  description  does  not  handle  the  problem  of  degeneracy,  which  will 
be  discussed  later. 

The  procedure  to  be  given  works  directly  with  the  forest  F  in 

D 

G  to  carry  out  these  four  steps.  The  concepts  introduced  here  will  be 
used  through  the  remainder  of  this  paper  although  the 


details  of  carrying  out  the  four  steps  will  differ  for  different 
problems. 

Let  (v.,  .  e_ ,  v  . . .  v  ,  e  v  )  be  a  simple  path  in  a 
network.  If  an  arc  ei  =  (v  ,  v  )  ,  then  e^  is  called  a  forward 

arc  in  the  path,  and  if  e^  ~  (v  ^  )  >  then  e_^  is  called  a 

reverse  arc  in  the  path.  Ir_  a  rooted  tree  there  is  a  unique  simple 
path  from  the  rcot  to  each  vertex.  £r  edg^  will  either  be  a  forward 
arc  or  a  reverse  arc  in  all  sue/'  paths,  and  forward  arc  will  be  called 
an  up  arc  with  respect  to  the  tree,  and  a  reverse  arc  will  be  called 
a  down  arc  with  respect  tc  the  tree.  Thus,  in  a  rooted  forest  each 
arc  can  be  designated  as  an  up  arc  or  a  down  arc. 

Several  operations  in  a  rooted  forest  will  be  described  for  later 
use  in  the  changing  of  basis  in  step  k.  These  operations  will  not 
depend  cn  whether  the  edges  ere  directed  or  undirected.  To  reroot 
a  tree  means  to  designate  another  vertex  as  its  root  and  drop  the 
old  root.  To  out  off  the  top  of  a  rooted  tree  at  an  edge  e  ,  means 
to  delete  the  edge  e  from  the  tree.  Then, part  cf  the  tree  becomes 
a  seperate  tree  which  has  no  root  and  is  called  the  top  of  the  tree. 
Either  one  of  its  vertices  can  be  designated  as  the  root,  or  it  can  be 
grafted  onto  a  rooted  tree  by  adjoining  an  edge  from  it  to  a  rooted 
tret  . 

Network  Linear  Programming  Algorithm 

Step  1 :  For  a  rooted,  spanning  forest  of  G  ,  the  dual  variable 

77  at  a  root  v  is  given  by  r  if  g+  is  basic 

i  i  J  i  i 

rl  "  l  - 

-c.  if  s.  is  basic  . 

i  l 
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If  7T.  is  determined,  then  for  an  up  arc  e  =  (v  ,  v.)  ,  r,  is 
i  it  l  j  j 

given  by  tt,  =  -c,  +  7 r  ,  and  for  a  down  arc  e,  *  (v  ,  v  )  ,  tt  is 
J  K  1  it  j  i  j 

given  by  =  c^  +  7i^  .  All  of  the  7t^  are  uniquely  determined 
iteratively  because  of  a  rooted  tree  being  connected  and  having  no 
cycles. 

Step  2:  To  price  out  and  select  a  new  variable  for  possible  entry  into 

the  basis,  search  for  an  arc  e£  or  a  vertex  v^  such  that  one  of 


the  following  holds : 


(a) 

+ 

Si 

3  0 

and 

\> 

(b) 

Si 

and 

"i  >  "C; 

(c) 

s  . 

J 

=  0 

and 

"j  <  'C. 

(d) 

+ 
s  . 

J 

+ 

and 

+ 

7T  /  C 

j  V  •) 

(e)  e£  -  (Vi,  v.)  ,  x£  =  0  ,  and  tt±  -  tt.  >  c 

(f)  e£  =  (v  ,  vi)  ,  =  a£  ,  and  tt  -  7^  <  c 


& 


If  none  of  (a)-(f)  is  found,  then  the  solution  is  optimal.  Otherwise, 
go  to  step  3  with  such  a  variable. 

Step  3-  The  feasibility  conditions  here  axe  0<^x<^a  ,  O^s^o  . 

In  cases  (a)  and  (b)  of  step  2,  let  v^  be  the  root  of  the  tree 
containing  v^  ,  and  let  P  =  (v^e  ,  V2*'  *  '  ’  Vi  l,ei  ]  ’  Vi  ^  be  the 
path  in  Fn  from  v  to  v  . 

D  XI 

In  cases  (c)  and  (d),  let  be  the  root  of  the  tree  containing 

v  ,  and  let  P  =  (v  . ,  e  v  ,  , . .  .  ,v  ,  e  ,  v  )  be  the  path  in 

j  J  J  J+l  *”1  i!-l  n 

F  from  v  to  v  . 

B  j  r 

In  cases  (e;  and  (f),  suppose  that  v  and  v.  are  in  different 

X  J 

trees  of  F  •  Then,  let  v  be  the  root  of  the  tree  containing  v. 

hi  i 

and  v  be  the  root  of  the  tree  containing  v  . 

r  J 


Suppose  that  the 
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to  v^ 

is 

(vx,  e.,  v2,...,v±_ 

to  V 

r 

is 

6  1  J  V4  i  >  •  •  •  f 

0  J  d+J- 

P  -  <V  *1’  V-”'  Vl-1'  *1-1'  V  V  VJ’  V  VJ+l’-"’Vr-l’  *r-l'  Vr>* 
For  all  of  the  above  cases,  Increase  x^  "by  6  if  is  a 

forward  arc  in  P  and  decrease  by  9  if  is  a  reverse  arc 

in  P  .  For  the  first  vertex  in  P  ,  increase  s  by  9  or 

*4*  *4* 

decrease  s^  or  y  by  9  ,  whichever  is  basic  cr  entering  there.  For 
the  last  vertex  v  in  P  ,  decrease  y  or  s  by  9  or  increase 

s+  by  9  ,  whichever  is  basic  or  entering  there.  Set  9  at  the 
largest  value  consistent  with  feasibility  and  go  to  step  4.  If  there 
is  no  bound  on  how  large  9  can  be,  then  the  problem  has  an  unbounded 
objective  function. 

In  cases  (e)  and  (f),  suppose  that  vt  and  v  are  in  the  same 

tree  of  Fn  .  Let  P  ®  (v e  ,  v  ..,v  ,  e  ,  v  )  be  the  path  in 

•D  J  J  J  +1  1-1  1-1 

F„  from  v  to  v  .  Increase  x  by  9  If  e  is  a  forward  arc 
B  j  1  k  k 


in  P  and  decrease  x^  by  9  if  e  is  a  reverse  arc  in  P  .  In 

case  (e),  increase  x.  by  ©  .  Ir.  case  (f),  decrease  x.  by  9  . 

jL  j 

As  before,  set  9  at  i:he  largest  value  consistent  with  feasibility 
and  go  to  step  4. 

Step  4:  If  the  increase  in  9  was  stopped  by  the  new  variable  reaching 

its  upper  or  lower  bound,  then  it  remains  nonbasic,and  the  algorithm 
returns  to  step  2.  Otherwise,  the  new  variable  enters  the  basis,  and 
a  blocking  variable  is  dropped.  We  will  consider  the  corresponding 
arcs  or  roots  as  entering  F_  and  dropping  from  F_  .  There  are  five 
cases  to  consider.  The  reference  is  to  Example  1,  which  follows. 
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(a)  A  root  enters,  and  a  root  drops.  Then  the  tree  is  rerooted. 
(Example  1,  (l)). 

(b)  A  root  enters,  and  an  arc  drops.  The  arc  dropping  cuts  off  the 
top  of  the  tree,  and  the  root  enters  on  the  top  of  the  tree. 
(Example  1,  (4)) 

(c)  An  arc  enters  from  one  tree  to  another,  and  a  root  drops.  The 
tree  from  which  the  root  dropped  is  grafted  onto  the  other  tree 
by  adjoining  the  entering  arc.  (Example  1,  (2),  (3),  (6),  (8) ). 

(d)  An  arc  enters  from  one  tree  to  another,  and  an  arc  drops.  The 
arc  dropping  cuts  off  the  top  of  one  tree.  The  top  is  then 
grafted  onto  the  other  tree  by  adjoining  the  entering  arc. 
(Example  1,  (5)). 

(e)  An  arc  enters  with  both  vertices  in  the  same  tree.  Then, 
necessarily,  an  arc  drops.  The  tree  is  not  changed  except  for 
addition  of  one  arc  and  deletion  of  another  arc.  (Example  1,(7)). 

Example  1  Suppose  warehouses  1  and  2  have  supplies  of  10  and  6 

box  car  loads  of  thread.  Storage  capacities  are  7  box  cars  at  each 
warehouse,  and  storage  costs  are  $2  per  box  car  per  week  for  warehouse 
1  and  #1  per  box  car  per  week  for  warehouse  2.  Suppose  mills  3,4,  and 
3  will  need  0,1,  and  8  box  car  loads  of  thread  in  the  coming  week. 

The  u±.M s  have  no  excess  storage  space  and  must  meet  these  demands  by 
shipment  from  warehouses  1  and  2.  The  train  lines,  available  space, 
and  costs  are  shown  below  in  algebi'ic  form.  The  corresponding 
graphical,  form  illustrating  the  routes  is  shown.  The  slacks  s+  and 
s~  are  indicated  by  arrows  out  of  and  into  ,  respectively.  All  of 
the  lower  bounds  are  0  . 
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The  simplex  method  starts  with  phase  I, in  which  all  of  the  cost 
are  0  except  for  artificial  variables.  The  entering  variables  will 
be  indicated  by  dotted  lines,  and  the  variables  dropping  from  the 
basis  will  be  indicated  by  X  .  The  symbol  j  |»  indicates  a 
variable  at  upper  bound,  but  the  arc  is  not  drawn  so  that  the  tree 
structure  of  the  basis  will  be  clear.  The  values  of  the  basic 
variables  are  indicated  by  numbers  next  to  the  arrows  and  dual 
variables  by  numbers  next  to  the  vertices.  Each  iteration  below 
includes  the  5  steps  of  the  simplex  algorithm  except  that  the  new 
values  of  the  basic  variables  are  not  shown  until  the  next  diagram. 
Two  iterations  are  done  in  (l)  and  (2),  but  should  not  cause  con¬ 
fusion  because  they  are  on  different  components  of  F  . 


its  upper  bound  first. 
Similarly,  s*  can  enter 
and  the  artificial  at 
v2  drops. 


The  new  basic  and  dual 
values  are  shown,  s*  is 
upper  bounded  at  7  • 


tt2  -  tt4  -  +1  >  0  anc* 
x.  ■  0  ,  and  -n  -  7TL.  = 
•  2  >  0  and  =  0  so 


x,  and 
4 


x 


7 


enter. 


Two 


artificials  drop. 


7T  -  7T  =>  +2  >  0  and  x  = 
1  5  1 

0  so  enters, and  the 

artificial  at  drops. 


2 

0 


4 

0 


7 
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(4) 


-1 


7T^  a  -1  <  0  and  s*  = 

0^  a  7  so  s*  enters 
the  basis,  and  x^  drops  at 
its  upper  bound.  Note 


*7 


could  have  been  chosen 


to  drop  as  well. 


77^  -  7Tj  ■  +1  >  0  and 

4  x^  =  0  so  x,  enters  the 
6  6 

basis,  and  x^  drops  at 
upper  bound. 
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For  phase  I,  let  us  denote  the  dual  variables  by  instead 

of  7ri  and  let  d,  ^  -(pi  -  p^.)  when  eR  =»  (v^  v,)  ,  d^  =  -p<  ,  and 

a  p^  ,  Theorem  4  says  the  matrix  B  is  a  basis  of  A0  if,  and  only 

if  F  is  a  rooted,  spanning  forest  of  G  ,  provided  that  G  has  a 

*  B 

vertex  corresponding  to  a  column  of  U  for  each  connected  component 

of  G  .  Phase  I  starts  with  artificials,  which  are  the  3ame  as  slacks 

singled  out  to  be  minimized,  at  all  of  the  verti'  js  of  G  so  G  does 

have  a  vertex  with  slack  in  each  connected  component.  The  simplex 

method  goes  from  basis  to  basis,  and  the  rank  of  every  basis  is  the 

same  provided  we  go  from  phe.se  I  to  phase  II  by  fixing  the  values  of 

and  eliminating  from  further  consideration  those  variables  at  zero  with 

d  >  0  and  those  variables  at  upper  bounds  with  d  <  0  .  Theorems  1 

and  2  assure  that  F-  will  always  be  a  spanning  forest  of  G  with  at 

B 

0 

most  one  root  on  each  tree  for  B  a  basis  of  A  .  If  some  tree 
did  not  have  a  root,  then  the  basis  would  have  lower  rank  than  the 
original  basis  contradicting  the  above  statement  which  always  holds 
for  the  simplex  method.  Hence,  the  assumption  that  every  connected 
component  of  G  has  a  vertex  with  a  slack  is  justified  because  it 
always  holds  in  the  computational  procedure. 

A  labeling  procedure  can  easily  be  devised  to  assist  is  carrying 
out  the  computation  as  described.  However,  an  efficient  labeling 
procedure  for  this  algoritlim  must  be  able  to  go  up  the  tree  as  well 
as  down  the  tree.  Some  promising  work  along  these  lines  has  been  done 
by  Scions  [1C]  and  others. 

The  algorithm  given  does  not  resolve  the  degeneracy  problem. 
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That  is,  in  step  4  if  several  variables  ore  blocking  variables, 
how  do  we  decide  which  one  to  drop?  In  example  1,  this  question  arises 
in  iteration  (4).  In  practice,  the  algorithm  is  almost  always  finite 
without  any  special  procedure  for  resolving  degeneracy.  The  next 
section  treats  degeneracy  ir.  a  beater  ./ay  tnan  can  usually  be  done. 

5  Phase  I 

Phase  I  of  the  network  flow  problem  is  called  the  max-Ilow  problem. 
Roughly, this  name  originates  by  considering  the  artificials  as  being  a  def¬ 
icit  flow,  and  the  problem  being  to  maximize  flow  or  minimise  ohio  deficit. 

To  begin,  sec  the  variables  x  ,  s  at  zero.  Let  yT  =*  b, 

if  b^  >  0  and  y^  =  -b^  if  b^  <  0  .  Tne  costs  d  are  0  for 

all  variables  except  artificials  and  d*  =  d,  =  1  for  artificials 

^  o' 

y*  and  y^  .  The  dual  variables  are  denoted  by  .  The  artificials 
are  actually  slacks  which  are  distinguished  by  having  d  1  . 

Steps  1,  2,  and  of  the  simplex  algorithm  offer  some  ob  clous 
simplifications  for  this  max-flow  problem.  Step  4  can  be  modified 
to  resolve  the  degeneracy  problem  in  a  much  better  way  than  Is 


generally  available  for  a  linear  program  and  e . eu  better  t.uan  is 


available  for  the  network  flow  problem.  One  of  the  modification--,  is 

■+•  -f 

the  use  of  slacks  s,  =  0  which  have  equau.  to  zero,  ovr.  were 

not  originally  present  in  the  problem  so  have  0+  equal  to  zero.  Those 
slacks  are  dummy  slacks  added  to  give  a  root  to  a  tree,  but  they  must 
remain  zero  because  no  slack  is  permitted  there.  Once  they  become 
nonbasic,  they  are  dropped.  To  begin,  if  b^  -•  0  ,  let  a  slack  c-e 
basic  at  if  there  is  a  slack  there.  If  not,  adjoin  a  slack 
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8*  with  a*  0  .  The  rooted,  spanning  forest  consists  now  of 

trees  consisting  of  one  vertex  which  is  the  root  of  the  tree. 

Max -Flow  Algorithm 

Step  1;  All  of  the  p  are  +1,  0,  or  -1  depending  on  whether 
the  tree  containing  ha3  a  root  with  y*  ,  a  slack,  or 

y-  .  Hence,  determining  the  dual  variables  is  simply  a  matter  of 

determining  the  root  of  the  tree  containing  the  vertex  v^  and  is  no 
longer  an  arithmetic  operation. 

Step  2:  Let  V1  3  £  ^  I  ^  "  +1h  v0  3  I  ^  n  ^  " 

(vi  j  a  -1}.  Then,  pricing  out  and  selecting  a  new  variable  is 
reduced  to  searching  for  one  of  the  following: 

(a)  v  g  ,  and  s*  u  o  cr  s.^  "  0^  ; 

(b)  vjEV;,  and  a-  .  a*  nr  s’  .  0  ; 

(c)  e{  -  {v1,  v  )  ^  ■>  0  ,  ard  £  V^,  v;  f  ^  ,  or 

Vi  €  V  VJ  €  \  ’  01 

vi  e  V  VJ  e  V3  J 

(d)  et  -  (v,,  vi)  ,  x£  "  a,  ,  and  V1  e  \  >  v,  €  v?  .  or 

vi  e  V1  >  vj  e  Ve  ’  or 

V1  €  V2  >  V  V 


Hence,  pricing  out  as  well  as  determining  the  dual  variables,  is  not 
an  arithmetic  process,  hut  is  only  a  search.  Note  that  cases  (a)  and 
(b)  of  step  2  in  the  network  linear  programming  algorithm  have  now 
been  collapsed  into  case  (a)  ard  cases  (c)  and  (d)  there  into  case  (b). 
If  none  of  (a)-(d)  is  found,  then  the  solution  is  optimal.  Otherwise, 
go  to  step  3  with  such  a  variable. 


Step  3:  Step  3  is  the  same  as  for  the  network  linear  program  iing 


algorithm  except  that  an  entering  arc  will  never  have  both  vertices 
in  the  same  tree  because  an  entering  arc  always  lias  vertices  in 
different  V  .  Hence,  the  flow  will  change  by  amount  G  among  a 
path  P  from  y*  to  y"  ,  or  from  yT  to  a  slack,  or  from  a 
slack  to  y”  .  Since  y  ^  0  is  now  part  of  the  feasibility  condition, 
there  is  always  a  bound  on  how  large  G  can  be  set  without  violating 
feasibility.  The  path  P  is  called  a  flow  segmenting  path  because 
the  change  in  flow  results  in  a  decrease  in  the  artificials  the 
end  of  P  . 

Step  4  (i) :  Step  4(i)  is  the  same  a?  step  4  cf  the  network  linear 

programming  algorithm  except  that  case  (e)  there  never  occurs  here, 
and  here  we  specify  in  certain  cases  which  of  the  blocking  variables 
to  drop. 

If  an  artificial  y*  or  y^  reaches  zero  in  step  >,  the; a  change 
it  to  a  slack  s*  =  0  with  a|  =  0. 

If  P  has  two  slacks  at  its  ends, then  any  blocking  varia.u.e 
can  be  dropped.  If  P  has  cue  slack  and  cue  artificial,  ukou  c’.-on 
the  blocking  variable  nearest  in  P  to  the  artificial,  if  r  has 
an  artificial  at  each  end  and  only  one  variable  is  e.  blocking  variable, 
then  drop  it.  Otherwise,  there  are  at  least  two  blocking  variables 
corresponding  to  arcs  in  P  .  i>rop  the*  blocking  arc  nearest  c-ue  enu 
of  P  and  the  blocking  arc  nearest  the  other  end  of  ?  .  On  e. 
vertex  v^  of  P  between  these  two  arcs,  put  a  slack  s+  0  with 
0+  m  0  .  Now,  there  are  three  rooted  trees  where  there  were  Tc  rooted 


trees  before 
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Step  4(li ) :  If  in  step  4(i},a  tree  with  an  artificial  y*  at 

the  root  had  another  tree  or  top  of  a  tree  grafted  onto  it,  then 

Degin  at  the  edge  adjoined  in  the  grafting  and  trace  the  tree  away 

from  the  root  along  every  branch  until  either  an  end  of  the  tree  is 

reached,  or  an  up-arc  e  =  (v^>  v  )  at  upper  bound  is  reached,  or 

a  down-arc  e  ™  (v^,  v  )  at  lover  bound  is  reached.  If  either  of  the 

two  types  of  arcs  e  is  found,  cut  off  a  top  of  the  tree  by  deleting 

e  from  F_  and  make  v  a  root  of  the  top  with  slack  at  zero  and 
B  2 

upper  bound  of  zero. 

Repeat  for  artificials  y^  except  look  for  up-arcs  at  lower 
bound  and  down-arcs  at  upper  bounds. 

Return  to  step  1. 

Proof  of  flnltcness  of  the  algorithm:  The  observation  in  step  3 

that  the  flow  augmenting  path  P  is  from  v^  with  y+  to  v^ 
with  y~  ,  or  from  y*  to  a  slack,  or  from  a  3lack  to  y”  is 
important  because  it  shows  that  the  flow  change  along  P  in  step  3 
is  always  away  from  y*  and  toward  y^  .  But  step  4(ii)  assures 
that  at  any  iteration  there  can  always  be  a  positive  flow  change  away 
from  the  root  of  a  tree  with  root  y*  and  toward  the  root  of  a  tree 
with  root  y~  .  If  any  Iteration  does  not  result  in  a  change  in  flow, 
then  the  blocking  variable  carrot  be  the  entering  arc  or  an  arc  in 
the  tree  with  an  artificial  so  the  tree  with  an  artificial  grows  by 
at  least  the  entering  arc.  Hence,  the  number  of  elements  in  decreases 

at  each  Iteration  which  does  not  result  in  a  change  in  flow.  But, 
there  are  only  m  vertices  in  all  so  there  can  be  at  most  m  iterations 


26 


in  a  row  resulting  in  no  change  in  flow. 

If  a  ,  o  ,  and  b  are  integer,  then  each  change  in  flow  results 
in  an  integer  decrease  in  the  sun  of  the  artificial  variables.  If  the 
original  sum  of  the  artificials  is  M  ,  then  the  algorithm  cannot  take  more 
than  m  M  iterations  because  the  artificials  are  non-negative. 

Even  with  fractional  and  irrational  a  ,  a  ,  and  b  ,  finite 
convergence  of  the  algorithm  can  be  proven.  The  variables  in  the 

forest  F-  a re  determined  once  all  the  other  variables  are  determined. 

B 

But  the  other  variables  can  take  on  only  two  values,  their  upper  and 
lower  bounds.  Hence,  a  given  forest  can  only  take  on  a  finite  number 
of  values  and,  hence,  can  only  recur  a  finite  number  of  times.  There 
are  a  finite  number  of  rooted,  spanning  forests  so  the  algorithm  is 

finite. 

The  reason  the  Ford-Fulkerson  labeling  procedure  for  the  max-flow 
problem  may  not  be  finite  (page  21  f  ]  )  when  a  ,  a  ,  and  b  are 
Irrational  is  that  the  variables  strictly  between  their  upper  and  lower 
bounds  may  not  form  a  forest;  that,  is,  they  may  form  cycles.  This 
difficulty  can  be  overcome  within  the  framework  of  that  procedure 
by  forming  the  set  E.  of  arcs  between  their  upper  end  lower  bounds. 

After  each  breakthrough,  the  labeling  procedure  is  done  first  in 
and  then  using  arcs  not  in  but  checking  all  of  the  arcs  in 

each  time  a  new  vertex  is  labeled  and  unscanaed.  Then,  the  arcs 
between  their  bounds  never  form  a  cycle.  For  a  network  with  one 
source,  one  sink,  and  no  slacks,  the  labeling  procedure  with  this 
modification  is  a  way  of  accomplishing  the  above  algorithm  except  that 
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the  trees  in  V0  e-re  now  kept  track  of.  The  labelling  procedure 

L. 

destroys  ail  the  labels  after  a  change  in  flow.  Whether  a  more  efficient 
labeling  procedure  can  ce  devised,  to  modify  labels  with  change  in 
flow  is  yet  tc  be  seen. 

The  Ford-Fulkerson  procedure  converts  a  general  network  flow 
problem,  to  a  problem  with  one  source,  one  sink,  and  no  slacks.  This 
conversion  was  r.ot  done  here  because  the  purpose  is  to  develop  the 
network  flow  theory  within  the  framework  of  linear  programming  in 
order  to  show  tne  connection.  Adjoining  the  additional  source,  sink, 
and  slack  vertex  makes  sense  graphic  ally ,  but  not  algebraically,  and  the 
graphical  procedure  without  adjoining  additional  vertices  is  closer  to 
the  linear  programming  procedure,  bote  also  that  positive  lower  bounds 


are  handled  easily  because  no  assumption  is  made  on  b  . 

In  summary,  the  advantages  of  the  max-flow  algorithm  over  the 
network  linear  programming  algorithm  are  simplicity  in  determining 
dual  variables  and  pricing  oat,  end  the  fact  that  at  meet  re  iterations 
in  sequence  can  occur  -with  r.o  change  m  flow.  This  fact  is  a  result 
of  having  no  arcs  enter  with  booh  er.de  in  the  same  tree  because  when 
that  happens  the  flow  c ’range  is  toward  the  root  in  come  arcs  and  away  from 
the  root  in  others.  Tie  flow  change  is  always  away  from  a  root  v^ 
with  y*  and  toward  a  root  v  with  y”  .  The  trees  attached  to 
roots  with  artificials  are  constructed  so  that  such  a  flow  change  Is 


possible. 

6. _  Tie  Primal -Duel  Method  for  Network  FI  ows 


The  primal-dual  method  was  devised  {6]  for  the  network  flow 
problem,  and  then  it  vas  generalised  to  the  general  linear  program 
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[;')].  Its  advantage  over  the  simplex  method  depends  on  some  simplification 
for  the  restricted  phase  I  problem.  For  network  flows,  its  advantages 
over  the  network  linear  programming  algorithm  are  the  same  as  the 
advantages  of  the  max-flow  algorithm  just  given. 


The  primal -dual  method  starts  with  a  tt  ,  x  ,  and  s  satisfying  the 

dual  feasibility  conditions  and  0£x£a,  O^s^a,  but  not 

Ax  +  Us  =  b  .  If  c  0  ,  then  7T.  =  0  all  i  and  x  =  s+  =  s  =  0 

1  K  1  j 

is  such  a  7r  ,  x  ,  and  s  .  If  c  ,  c*  or  c~  is  negative,  set  the 
corresponding  variable  at  upper  bound.  If  there  is  no  upper  bound, 
then  set  an  upper  bound  M  and  let  the  variable  be  equal  to  M  . 

If  at  the  conclusion  the  variable  is  still  equal  to  M  ,  then  raise 


the  upper  bound  M  ,  introduce  new  artificials,  and  solve  again. 

Starting  with  a  tt  ,  x  ,  end  s  satisfying  (l)  ,  and  0  £  x  £  a  , 
0  £s  ,  the  primal  -dual  method  uses  the  max-flow  algorithm 
restricted  to  arcs  e^  ®  (v^,  v^ )  and  slacks  s+  and  s^  such  that 
7T.  -  tt.  =  c,  ,  tt,  a  c,+  .  and  7T.  a  -c*  .  At  the  conclusion  of  the 

■4  ir  '  ri  7  U  U 


max-flow  subroutine,  the  rr's  are  changed  to  ^  +  £)  V  Vi  ’ 

and  7T.  -  €  y  v t  €  V,  i  where  e  is  chosen  as  large  as  possible  without 
1  15 

violating  the  dual -feasibility  conditions  (l).  Note  that  e  >  0  . 

The  max-flow  subroutine  is  the  primal  step,  and  the  dual  change 
is  the  dual  step.  The  two  alternate  until  either  no  artificials 
remain  in  the  primal  step  or  until  there  is  no  bound  on  how  large  e 
can  he  chosen  in  the  dual  step.  If  there  are  no  remaining  artificials, 
then  the  solution  tt  ,  x  ,  s  is  optimal.  If  there  is  no  bound  on 
e  ,  then  there  is  no  solution  to  Ax  +  Us  =  b  ,  0  £  x  £  a  ,  O^s^a 
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7.  Flows  with  Gains 

A  network  with  gains  is  defined  to  be  a  network  G  together  with 
a  function  w  on  E  ,  the  edges  of  G  ,  to  the  reals.  Then,  w(e) 
is  the  gain  associated  with  the  edge  e  .  Assume  w(e)  ^  0  . 

1  if  arc  e  *  (v  ,  v)  for  some  v  €  V 

|  • 

Define  a  3  i  w(e  )  if  arc  e,  ■  (v.  v.)  for  some  v  e  V 

ik  L  k  k  i 

0  otherwise 

The  linear  program  in  a  network  with  gains  or  flows  with  gains  [8] 
problem  is : 

Ax  +  Us  =  b  ,0£x£0f  ,  O^s^a, 

(2) 

cx  +  cs  =  z(min) 

If  w(e  )  =  -1  for  all  arcs  e,  ,  the  problem  is  the  same  as  in 
k  K 

sections  1-6,  If  w(e^)  >  0  and  the  graph  is  bipartite,  Dantzig  [2] 
has  called  the  problem  the  weighted  distribution  problem  and  given  the 
structure  of  the  basis.  Here  the  basis  is  slightly  more  complex  than  in 
sections  1  through  6.  First,  a  preliminary  lemma  is  needed. 

Lemma  7  A  connected  graph  G  with  k  vertices  and  k  edges  has 
one  cycle,  and  if  the  edges  of  the  cycle  are  removed,  then  the 
remaining  graph  is  a  forest  with  each  tree  having  exactly  one  vertex  in 
the  graph. 

Proof:  The  graph  G  must  have  at  least  one  cycle  since,  otherwise, 

G  would  be  a  tree,  and  a  tree  with  k  vertices  has  k-1  edges  by  lemma  4. 


Suppose  G  has  two  cycles.  Then,  '.here  is  an  edge  of  G  in 
one  cycle  but  not  in  the  other.  The  removal  of  that  edge  from 
G  does  not  destroy  connectedness  and  leaves  one  cycle  in  G  . 

Then,  G  has  k  vertices  and  k-1  edges  so  is  a  tree  by  lemma  4; 
but  a  tree  has  no  cycles  so  a  contradiction  is  reached. 

If  all  of  the  edges  of  the  cycle  are  removed,  then  the  remaindei 
of  the  graph  is  a  forest  because  it  has  no  cycles.  Each  tree  of  the 
forest  must  include  a  vertex  of  the  cycle  because  the  original  graph 
G  was  connected.  Suppose  there  were  two  vertices  of  the  cycle  in 
some  tree  of  the  remaining  forest.  Then,  there  is  a  path  in  the  tree 
between  the  two  vertices  and  a  path  in  the  cycle  between  the  two 
vertices.  Together,  they  form  a  cycle.  Hence,  the  original  graph 
G  would  have  had  two  cycles  contradicting  the  previous  part  of  the 
lemma.  Thus,  the  lemma  is  proven. 

Let  A°  «  [A,  U]  , 

Theorem  5  Let  A°  have  rank  m  .  The  connected  components  of 

the  graph  corresponding  to  a  basis  B  oi  A0  is  either  a  rooted 

tree,  or  a  graph  with  the  same  number  of  vertices  and  edges  and  having 
no  slack. 

Proof:  A  proof  similar  to  the  proof  of  theorem  2  shows  that 

can  have  at  most  one  slack  corresponding  to  a  connected  component. 

The  same  idea  as  before  of  sending  one  unit  of  flow  from  one 
slack  to  the  other  along  a  simple  path  is  still  aplicable,  but  the 
algebraic  details  are  more  complicated  and  are  oraiuted  here. 

If  a  connected  component  of  on  k  vertices  has  k+1  or 

more  corresponding  columns  of  B  ,  then  those  k+1  or  more  columns 


have  only  k  rows  with  non-zero  entries,  contradicting  independence 
of  the  columns  of  B  . 
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Therefore,  if  a  connected  component  of  with  k  vertices 
has  one  slack,  then  it  cannot  have  more  than  k  -  1  edges.  It  must 
have  k  -  1  edges  to  be  connected.  Hence,  the  component  is  a  rooted 
tree.  If  a  connected  component  of  with  k  vertices  has  no  slack, 
then  it  cannot  have  more  than  k  edges.  But  P?  and  ,  hence,  B 
have  rank  m  ,  so  each  connected  component  must  have  as  many  corresponding 
columns  of  B  as  vertices.  Hence,  a  connected  component  with  k  vertices 
and  no  slack  must  have  k  edges,  and  the  proof  is  completed. 

In  sections  }-6  the  basic  was  always  triangular,  and  the  entries  were 


+1  and  -1  .  Here,  even  when  the  basis  is  triangular,  the  entries  are 
not  +1  and  -1  but  are  1  and  w(ek)  .  The  changes  in  steps  1-3 
of  the  network  programming  algorithm  given  in  section  4, 
due  to  the  gains  w(e,  )  will  be  discussed  first  under  the 
assumption  that  the  graph  Eg  has  no  cycles;  that  is,  Hfi  is  a  rooted 
forest. 


Step  1:  At  the  root,  is  still  equal  to  c*  0r  -c”  .  If  tt± 

is  known  and  ek  -  (v^,  v  )  is  an  up-arc,  then  (c^  -  7^)  . 

k 

If  7r.  is  known  and  e  =*  (v  ,  v  )  is  a  down-arc,  then  it  = 

1  k  j  1  j 


ck  -  . 


Step  2;  Pricing  out  is  the  same  for  the  slacks,  but  for  the  arcs  it 


changes  to: 

(e)  =  (v1,  vj)  ,  =  0  ,  and  tt±  -  v(e£)  TTj  >  c£  ; 

(f)  e,  =  (vj,  v±)  ,  xi  -  o,  ,  and  Ttj  -  »(e,  )  ir,  <  e,  . 


Step  3:  This  step  is  similar  to  step  3  of  the  network  programming 
algorithm  except  for  two  differences. 

Previously,  the  flow  change  was  +9  or  -9  in  all  of  the  arcs 

of  P  .  Now,  suppose  P  »  (v^  v2«'*‘,ek-l'  \>  \>  \+1>  \+1»***> 

v  ,  e  ,  v  )  ,  and  x,  changes  by  J  ,  If  e  is  a  forward 

r-1  r-i  r  7  k  k 

arc  in  P  ,  then  x  changes  by  -  - r  d  if  e  is  a  forward 

k— 1  vie,  /  k-1 

arc  in  P  and  by  -9  if  e,  ,  is  a  reverse  arc  in  P  ;  and  x  , 

k-1  k+1 

changes  by  -w(e,  )9  if  •?.,  in  a  forward  arc  in  ?  end  by 

) 

-  r-  ...  *  q  if  »  is  a  reverse  arc  in  P  .  If  e,  is  a  reverse 
^1}  kfl 

arc  in  P  ,  then  the  change  in  x  ^  is  the  same  as  the  change  in 

X  above,  and  the  change  in  x  is  the  same  as  the  change  in  x 
k+1  K+1  K-1 

above.  The  change  in  slcak  at  v,  is  either  +  9  or  ±  wfe^)© 
if  changes  by  9  and  similarly  for  . 

The  second  difference  occurs  when  an  entering  arc  has  both  vertices 
in  the  same  tree.  Then  a  flow  change  can  take  place  not  only  around 
a  cycle,  but  down  the  path  from  the  cycle  to  the  root.  If  the  variable 
dropping  is  on  the  path  instead  of  the  cycle,  then  the  cycle  becomes 
part  of  the  basis. 

A  cycle  corresponds  to  a  matrix  of  the  form: 


where  +  indicates  a  non-zero  entry. 


For  any  right-hand  side,  a  system  of  equations  with  such  a  coefficienJ 
matrix  can  be  solved  by  considering  the  first  variable  to  be  a 
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parameter,  moving  it  to  the  right  hand  side,  and  solving  uhe  remaining 
system,  which  is  triangular. 

If  the  cycles  are  thought  of  as  being  a  single  vertex,  then  the 
connected  component  becomes  a  rooted  tree  with  the  cycle  being  the 
root.  In  step  1,  computing  the  dual  variables,  the  71^  around 
the  cycle  can  be  solved  first,  and  in  step  5,  computing  the  change 
in  flow,  the  flow  change  around  the  cycle  can  be  computed  last  as 
a  separate  subroutine  as  indicated  above.  Step  4,  the  change  in  basis, 
is  similar  to  the  network  programming  algorithm  except  that  whenever 
a  slack  enters  or  drops  there,  a  cycle  could  enter  or  drop  here  in  the 
sense  that  an  arc  enters  forming  a  cycle  or  an  arc  drops  destroying  a 
cycle.  The  cycles  can  form  when  an  arc  enters  with  both  ends  in  the 
same  tree  as  mentioned  in  step  5  above. 

Phase  I  for  this  problem  does  simplify  somewhat.  The  tree  without 
artificials,  including  the  trees  with  cycles,  all  have  dual  variables 
=  0  at  every  vertex  v^  .  The  only  computation  of  dual  variables 
is  on  trees  with  an  artificial,  but; there* actual  computation  must  be 
done.  Pricing  out  does  not  simplify,  but  every  entering  arc  will  have 
at  least  one  end  in  a  tree  with  an  artificial  variable  at  the  root. 

Hence,  any  change  of  flow  involving  a  cycle  will  be  along  a  path 
with  the  cycle  at  one  end  and  an  artificial  variable  at  the  other  end. 

However,  the  handling  of  degeneracy  in  the  max-flow  algorithm  in  sec 
i  or.;;  1-6  can  not  be  done  for  this  problem.  For  the  max -.flow  algorithm, 
the  flow  change  was  always  away  from  an  artificial  y*  and  toward  sun 
artificial  y”  .  That  tills  important  property  no  longer  holds  is 
illustrated  by  the  example  below. 


Example  1  The  network  iu  Illustrated,  below,  and  the  algebraic 

statement  of  the  problem  gives  the  edge  weights. 


33 


34 


basic,  and  y^  drops  . 


(2) 


\iG~ 

yv 


"1 


2  ‘'2 


2  >  0  so  \ 


enters,  arid  y^  drops 


1 
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Iteration  (3)  illustrates  a  case  when  the  change  in  flow  in  arc 
(vg  ,  v  )  is  toward  the  basic  artificial  y+  . 

[Hie  two  advantages  of  the  max-flow  algorithm  do  not  carry  over  to 
the  phase  I  problem  here,  except  that  the  dual  variables  on  a  tree 
without  artificial  variables  are  zero,  and  the  cycles  only  enter  into 
a  basis  change  at  one  end  of  a  path.  The  primal -dual  method  can  be 
used  here,  but  lacks  any  special  advantage  since  the  piiase  I  problem 
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does  not  significantly  simplify.  However,  there  is  a  special  case  of 
the  flows  with  gains  problem  in  which  the  Phase  I  problem  simplifies  as 


much  as  it  did  in  the  previous  chapter.  The  next  section  discusses 
that  problem. 

8,  Linear  Programming  in  ar.  Undirected  Graph 

Suppose  in  the  flows  with  gains  problem,  all  cf  the  gains 

w(e^)  «  +1  .  Then  the  matrix  4  is  a  vertex -edge  incidence  matrix 

of  an  undirected  graph  d  .  The  columns  :f  A  .. or re spend  tt  edges 

and  have  twe  +1  ee.tr  be  c  in- ideating  the  two  incident  vertices.  The  edges 

are  undirected  and  will  bo  written  e  «  lv.  >  v.j  to  distinguish  them 

k.  i  j 

from  directed  edges  or  ar  :.  The  order  :  f  v4 ,  v.  has  no  importance; 

.1 

there  is  at  most  cn?  edge  between  'r.  and  v  ,  and  [v.,  v  j  represents 

*-  o  J 

the  same  edge  as  lv  ■>  v  j  . 

J  u 

If  any  b^  <0  ,  then  there  must  be  a  s,  because,  otherwise,  there 

t.h 

would  be  no  feasible  solution  to  Ax  +  Us  •••  b  .  Hence,  the  i —  row 

n  n 

cf  Ax  +  Us  a  b  is  2  a.  xv  -  sj  -  b  .  and  c"  sj  =  -cTb^  +  2  (c'a  )x 

krO.  \  ^  *  ~  1  ~  1  X  k«l  1  \  J 

Therefore  c  car.  bs  repl’-u.ed  ty  zero  and  o  by  c  +  o  a  If 
i  k  k  i  i. 

n  ^ 

C  -  oo  ,  then  Z  a  x  >  t  holds  f  or  all  feasible  x  and,  hence, 

1  v_.  \  *  1 

the  i —  row  of  Ax  +  Us  -  b  can  just  be  dropped  from  the  system.  If 

n 

<  00  ,  then  adding  cj  to  both  sides  of  Z_  x^  -  s^  n  gives 
n  _  xk 

2  a  x  +  (c  -  s“)  -  b  +  o’  .  Now,  o'  -  s"  >  0  so  if  b  +  a”  <  0  , 
knl  \  K  -  '  1  1  J  1  11 

then  there  is  no  feasible  solution.  If  b^  +  C,  ^  C  ,  replace  b^ 

■  •  **  ^  "  ,4‘  • 

by  b  +  ,  replace  ^  by  C:  ,  and  set  0^  =  b  +  o^  . 

Therefore,  only  the  case  t  >  C  need  be  considered  here.  All  of  the 
artificial  variables  will  be  y*  eo  we  drop  the  +  and  just  write  y  . 
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Define  tie  length  of  &  cycle  to  be  the  number  of  edges  in  it. 


rj 

_6  If  3  is  a  basis  of  A  ,  then  the  cycles  in 


are  of 


odd  length. 

Proof:  Let  (v.^  ei,  e3t»  vi )  *e  »  cycle  of  even  length. 

a  .  A  ,  lf  ej  “  i\,  v  .A,  if  or  1-1 

iJ  ^  C  ,  otherwise  ^  and 


0,  otherwise. 
2k 


Let  x  •  1  for  J  even  and  x.  *  -1  for  J  odd,  Then  Z  a  .x.  -  0 
J  «  J-l  J 

for  «U  1  bmm  for  i^S,  ^  •  *«,  +  *i 

at 

0,  *ad  for  1-1,1  «tj*j  -  ♦  *i,ax2k  "  -1  +  1  *  0  •  HeMe> 


a  basis  could  not  Include  an  even  cycle  because  the  columns  corresponding 

to  an  even  cycle  are  lln** v  dependent. 

If  G  has  no  odd  cycles,  then  every  basis  has  no  cycle  so 

is  a  rooted  forest.  A  graph  G  with  no  odd  cycles  13  called 

bipartite  and  Is  easily  proven  to  have  the  property  that  the  vertices 

can  be  divided  Into  two  disjoint  sets  such  that  every  edge 

Is  incident  to  one  vertex  of  and  one  of  V  •  The  rows  of  tP 

corresponding  to  vertices  of  Vg  can  be  multiplied  by  -1  converting 
0 

A  Into  the  network  flow  type  matrix  This  section  is, 
therefore,  mainly  concerned  with  graphs  G  having  odd  cycles. 

Bach  odd  cycle  in  the  basis  will  be  considered  to  be  a  single  vertex 
so  that  the  resulting  graph  P£  corresponding  to  B  Is  a  rooted 
forest. 


For  a  rooted  tree,  define  the  distance  frost  the  root  to  a  vertex 
to  be  the  number  of  edges  in  the  path  from  the  root  to  the  vertex. 


39 


For  example,  the  distance  from  the  root  to  itself  is  zero.  Define 
the  distance  from  the  root  to  an  edge  to  be  the  number  of  edges  in 
the  path  from  the  root  to  the  vertex  of  the  edge  nearest  the  root. 

For  example,  an  edge  incident  to  the  root  is  distance  zero  from  the 
root.  The  edges  and  vertices  are  called  even  or  odd  according  as  the 
distance  from  the  root  is  even  or  odd. 

An  algorithm  similar  to  the  max-flow  algorithm  viLl  be  given  for 
Phase  I  of  this  problem.  To  begin,  set  the  variables  x  ,  c  at 
zero.  Just  as  in  the  max-flow  algorithm,  let  y^  =  b^  if  b  >  0, 
and  if  b^  =  0  let  a  slack  be  basic  at  if  there  is  a  slack  there. 

If  not, set  s+  3  0  and  G+  =  0  . 

For  a  tree  with  root  and  y^  basic,  the  even  edges  are 

called  Increasing  edges,  and  the  odd  edges  are  decreasing  edges. 
Increasing  and  decreasing  edges  are  only  defined  in  trees  with  an 
artificial  at  the  root. 


Alternating  Path  Algorithm 

Step  1:  The  dual  variables  p^  are  zero  on  trees  without  an  artificial. 

On  a  tree  with  root  v,  and  artificial  ,  p  =  +1  for  v.  an  even 

a  l  J  J 

vertex  and  n,  3  *1  for  v.  an  odd  vertex. 

J 

Step  2:  Let  ^  |  pi  =  +1),  Vg  |  «  0),  and  |  p±  »  -1}. 

Pricing  out  and  selecting  a  new  variable  amounts  to  searching  for  one  of  the 
following:  (a)  e  and  s*  3  0  or  «  c  ; 

(b)  v.  e  V_  and  s*  »  a*  or  s.  ■  0  ; 

0  3  1  T-  1 

(c)  e^  »  [vj.  ,  v^3  ,  x^  -  0,  an£  v±  e  ,  v^  e  vx  or 

Vi  €  V1  '  VJ  €  V2  ^ 

(d)  e£  =  tvi  '  >  xt  3  °k  >  and  vi  €  V3  '  vj  €  V3  or 

v  c  V  v  V  V 

i  e  V  J  2 


The  v  ,  v  are  not  in  any  order  so  which  of  v  ,  v.  is  in  V  and 
l  J  l  j  t 

which  is  in  V.  or  V  does  not  matter. 

1  5 

Step  3:  The  feasibility  conditions  are  O^x^a,  O^s^a  ,  0  y 
In  case  (a)  of  step  2,  let  v^  be  the  root  of  the  tree  containing 
v^  .  Since  v^  e  has  an  artificial  variable  because  all  of 

the  trees  with  artificial  variables  have  all  of  their  vertices  in  V  . 


Let 


P  =  (v  ,  e1,  v2> *• ei_i’  vi)  be  the  ?ath  in  F^  from  v] 


to  v.  . 

l 

In  case  (b)  of  step  2,  the  tree  containing  v.  has  a  root  v 

J  i* 

with  an  artificial  just  as  in  case  (a).  Let  P  =*  (v e  v  , , . . ,  v 

J  J  j+l  r-l 

e  ,  e  )  be  the  path  in  F  from  v  to  v  . 
r-1  r  B  j  r 

In  cases  (c)  and  (d),  suppose  v  and  v.  are  in  the  same  tree 

*■  J 

of  Fg  .  Then  v^  and  v^  are  both  in  or  both  in  so 

the  root  v  has  an  artificial.  Let  the  path  in  F_  from  v  to  v . 

1  B  i  j 

be  V  ej_i^  Form  the  cycle  V  vi+1>** 

vj-l>  'j-l’  V  V  and  let  p=  (vl>  *1'  V  — 'Vl'  er-l’  V 

be  the  path  F„  from  v  to  the  cycle,  where  v  is  a  vertex  uf  the 

B  1  r 

cycle. 

In  cases  (c)  and  (d)  ,  suppose  v  and  v.  are  in  different 

i  J 

trees  of  F^.  .  Let  v  be  the  root  for  the  tree  containing  v 
B  1  1 

and  v^  be  the  root  of  the  tree  containing  v  .  Suppose  the  path  in 

Ffi  from  ^  to  is  (v^  e±,  vg, . . . , v^,  e^,  and  from 

v.  to  v  is  (v,,  e  v.  _  ,...,v  ,  e  ,  v  ).  Let  P  = 

J  r  y  y  J+l  r-l 7  r-1  r 

(v  ,  e  ,  v  , . . . « b  ,  e  ,  v  ,  e„,  v  ,  e  ,  v  ,...,v  ,  e  ,  v  )  . 

K  1’  1’  2’  ’  i-1*  i-l'  i  £’  y  y  j+l'  '  r-1'  r-1'  r 

One  end  of  P  could  be  a  cycle,  but  at  least  one  end  of  P  must  be 
an  artificial.  In  case  (c),  designate  e^  to  be  an  increasing  edge, 
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and  in  case  (d)  designate  e^  to  be  a  decreasing  edge.  If  only  one 
end  of  P  has  an  artificial,  then  starting  at  and  going  toward  the 

end  of  P  without  artificial,  designate  the  edges  alternately  as 
increasing  and  decreasing  edges. 

Suppose  an  end  of  P  is  a  cycle.  Then  that  end  edge  in  P  is 
incident  to  a  vertex  of  that  cycle.  Denote  the  cycle  (v^,  e  ,  v  ..., 

V2k+1>  C2k+1'  Vl^  *  e^  as  an  increasing  edge  if  the  edge 

in  P  incident  to  the  cycle  is  decreasing,  and  e  is  a  decreasing 
edge  if  the  edge  in  P  is  increasing.  Going  around  the  cycle,  alternately 
designate  the  edges  as  increasing  or  decreasing.  The  edge  e  is 

designated  the  se  ne  p;,  e^  because  the  cycle  is  of  odd  length. 

Q 

Increase  by  —  if  e^  is  an  increasing  edge  in  a  cycle 

Q 

and  decrease  by  -  if  eR  is  a  decreasing  edge  in  a  cycle. 

Increase  by  ft  if  e  is  an  increasing  edge  of  P  and  decrease 


*k 


by  9  if  e^  is  a  decreasing  edge  of  P  .  Decrease  artificials 


at  the  end  of  P  by  9  .  If  a  slack  s^  is  basic  at  the  end  of  P  , 
then  increase  or  decrease  s*  by  9  according  as  the  edge  in  P 
incident  to  the  end  of  P  is  decreasing  or  increasing.  If  a  slack 
is  basic  at  the  end  of  P  ,  then  increase  or  decrease  s_^  by 
©  according  as  the  edge  in  P  incident  to  the  end  of  P  is  increasing 
or  decreasing.  Decrease  y^  by  9  if  v^  is  an  end  of  P  .  Set 
9  as  large  as  possible,  consistant  with  feasibility. 

Step  4(i):  The  types  of  basis  change  have  been  discussed  in  section 

1. 

If  an  artificial  reaches  zero  in  step  3,  then  replace  it  by  a  slack 


with  zero  upper  bound. 

If  P  now  has  artificials  at  neither  end,  any  blocking  variable 


can  be  dropped.  If  P  has  exactly  one  artificial,  then  drop  tne 
blocking  variable  nearest  in  P  to  the  artificial.  If  no  edge  of  P 
is  blocking, and  the  other  end  of  P  has  a  vertex-cluster,  then  drop 
any  blocking  edge  of  the  vertex-cluster.  If  P  has  an  artificial 
at  each  end  and  only  one  blocking  variable,  then  drop  it.  Otherwise, 
there  are  at  least  two  blocking  arcs  in  P  .  Drop  the  blocking  arc 
nearest  one  end  of  P  and  drop  the  blocking  arc  nearest  the  ether  end 
of  P  .  On  a  vertex  v^  of  P  between  these  two  arcs,  put  a  slack 
s*  =  0  and  o+  =»  0  .  Now  there  are  three  rooted  trees  where  there 
were  only  two  rooted  trees. 

Step  4(il) :  If  in  step  4(i)  a  tree  with  artificial  at  the  root  had 

another  tree  or  a  top  of  a  tree  grafted  onto  it,  then  begin  at  the  edge 
adjoined  in  the  grafting  and  trace  the  tree  away  from  the  root 
along  every  branch  until  an  increasing  edge  at  upper  bound  or  a  decreasing 
edge  at  lower  bound  is  reached.  Cut  off  a  top  of  the  tree  by  deleting 
the  edge  from  F,,  and  put  a  root  on  the  top  with  slack  at  zero  and  upper 
bound  of  zero. 

Return  to  step  1. 

The  algorithm  is  completed.  Now  its  correctness  and  finiteness  ’/dll 
be  proven. 

Lemma  9  The  increasing  and  decreasing  edges  alternate  along  P  . 

Proof:  The  edges  in  a  tree  with  artificial  alternate  between  increasing 

and  decreasing  along  any  path  in  the  tree  because  the  distance  from 
an  edge  to  the  root  alternates  between  even  and  odd  numbers.  Hence,  in 
step  2,  cases  (a)  and  (b),  the  lemma  is  certainly  true.  In  cases  (c 
and  (d),  if  one  end  of  P  is  not  an  artificial,  then  the  edges  of  P 


from  e.  to  that  end  alternate  because  the  edges  were  designated 

Xj 

increasing  and  decreasing  alternately  beginning  at  e^  .  In  case  (c), 
is  increasing,  and  in  case  (d)  ,  e^  is  decreasing.  The  proof 
of  the  lemma  will  be  completed  if  it  is  shown  that  in  case  (c)  the  edge 
e  in  P  next  to  e.  and  toward  a  root  with  artificial  is  increasing. 

If 

A  vertex  of  e Q  toward  a  root  with  artificial  is  in  V  in  case 

Xj  -L 

(c)  and  is  in  V  in  case  (d).  Hence,  in  case  (c)  the  vertex  of  e 

3 

furthest  from  the  root  is  in  and  in  case  (d)  it  is  in  V  . 

But  in  a  tree  with  artificial  at  the  root,  ,  1  increasing  edge  is  an 

even  edge  so  its  vertex  furthest  from  the  root  is  an  odd  vertex  and, 

hence  ^in  ,  and  a  decreasing  edge  is  an  odd  edge  so  its  vertex 

furthest  from  the  root  is  an  even  vertex  and,  hence,  in  .  Therefore, 

in  case  (c)  the  edge  e  is  decreasing  ;and  in  case  (d)  it  is  increasing. 

n 

Lemma  10  The  changes  of  variables  in  step  3  does  not  change  Z  a  x 

j=l  J  J 

in  a  cycle  or  in  P  except  at  the  ends  of  P  where  the  changes  are 
compensated  by  changes  in  slacks  or  artificials. 

Proof:  Lemma  4  proves  the  lemma  in  P  except  at  the  ends  of  P  . 

For  an  end  of  P  with  a  cycle,  the  change  in  the  variable  corresponding 

to  the  end  edge  of  P  is  compensated  for  by  the  change  in  the  variables 

corresponding  to  two  edges  of  the  cycle  incident  to  the  end  edge, 
n 

The  change  in  Z  a  x  for  other  vertices  v  of  the  cycle  is  zero 
j=d  J  i 

by  the  alternating  nature  of  the  edges. 

For  an  end  of  P  with  slack,  the  change  in  slack  was  defined  so  as 
to  compensate  for  the  change  in  the  variable  corresponding  to  the  end 


edge. 
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For  an  end  of  P  with  y^  ,  the  end  edge  is  increasing  so  y^ 
decreases. 

Lemma  11  In  step  2.  except  for  case  (c)  when  v.  €  V.  .  v .  €  V_  and 

i  1  j  2 

case  (d)  when  ,  Vj  €  V2  '  t*le  ^s^^ing  change  in  step  3 

causes  the  sum  of  the  artificials  to  strictly  decrease. 

Proof:  Step  4(ii)  assures  that  increasing  edges  are  less  than  their 

upper  bounds  and  decreasing  edges  are  greater  than  their  lower  bounds 

in  trees  with  artificials  at  the  roots.  Hence,  cases  (a)  and  (b)  of 

step  2  always  result  in  a  decrease  in  the  artificial  at  the  root.  Cases 

(c)  and  (d)  for  which  v  and  v  are  both  in  V  or  both  in  V  , 

1  j  l  3 

but  in  different  trees  of  ,  always  result  in  a  decrease  in  both 

artificials.  The  remaining  consideration  is  cases  (c)  and  (d)  when 

v  and  v.  are  both  in  the  same  tree  and  both  in  V  or  both  in 
1  J 

V  .  In  the  path  P  ,  variables  corresponding  to  increasing  edges 
3 

can  increase  and  variables  corresponding  to  decreasing  edges  can 


decrease  because  they  are  in  a  tree  with  artificial.  Let  the  cycle 
be  (v, ,  e. ,  v  , .  ,.,v  ,  e  ,  v.  )  where  the  end  of  P  is  incident 

to  v,  and  e.  is  the  entering  edge.  Then  the  edges  other  than  e 

1  Jb  Xj 

are  increasing  or  decreasing  the  same  as  they  were  before  in  the  tree 


because  e.,  and  e^,  ,  are  both  opposite  of  the  end  edge,  and  the 

edges  alternate  from  e^  and  e^+^  until  e^  is  met.  In  case  (c), 

e-  will  be  designated  as  increasing  and  in  case  (d)  as  decreasing  just 
JO 

as  in  the  proof  of  lemma  4.  Therefore,  the  variable  corresponding  to 


every  increasing:  edge  can  increase,  and  the  variable  corresponding  to 
every  decreasing  edge  can  decrease  so  the  artificial  strictly  decreases. 
Lemma  If  a  ,  a  ,  and  b  are  integer,  then  all  variables  are 
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integer  except  possibly  for  edges  in  a  cycle  which  are  integer  divided 

by  two,  and  the  change  9  in  step  3  is  always  integer. 

Proof:  Initially  the  lemma  is  true.  Suppose  it  is  true  at  the 

beginning  of  an  iteration.  Then  the  permissable  change  in  a  variable 

is  an  integer  unless  it  is  an  edge  of  a  cycle  in  which  case  the  change 

is  an  integer  divided  by  two.  But  the  variables  all  change  by  © 

© 

except  for  the  edges  of  the  cycle  which  change  by  —  .  The  size  of 

0  k 

©  is  determined  either  by  ©  =  k  or  —  =  ,  so  ©  is  integer. 

All  of  the  variables  change  by  ©  except  around  a  cycle,  so  they  remain 
integer  except  around  the  cycle  where  they  remain  integer  divided  by 
two. 

Theorem  6  At  most,  m  iterations  of  the  algorithm  can  occur  in 

sequence  without  any  change  in  the  artificials,  and  the  algorithm 

terminates  i.i  n  x'.nlte  number  of  steps.  If  a  ,  0  ,  and  b  are  integer 
m 

and  I  |  bj  j  «  M  ,  then  the  algorithm  terminates  in  at  most  M  m  steps. 
i=l  ~ 

Proof:  By  lemma  6,  the  only  iterations  that  could  result  in  no 

decrease  in  artificials  are  iterations  for  which  in  step  2,  cases  (c ) 
or  (d)  occur  with  one  vertex  in  Vg.  Since  9=0,  the  blocking  variable 
could  not  be  in  the  tree  with  artificial  and  is  not  the  entering 
variable.  Hence,  the  tree  with  artificial  will  grow  by  at  least  the 
entering  edge.  Therefore,  Vg  decreases  in  size  by  at  least  one  vertex 
in  every  iteration  for  which  ©  =  0  .  There  sire  only  m  vertices 
so  no  more  than  m  iterations  in  sequence  could  occur  with  no  change 
in  artificials. 

Finiteness  follows  in  the  same  way  as  for  the  max-flow  algorithm 
and  indeed  for  linear  programs  in  general  cnce  the  objective  has 
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been  shown  to  decrease  every  finite  number  of  iterations.  The  bound 
m  M  when  a  ,  a  ,  and  b  are  integer  follows  just  as  before. 

This  algorithm  enjoys  the  same  advantages  as  the  max-flow  algorithm 
and  for  similar  reasons.  Here? cycles  can  form,  but  the  essential 
fact  is  that  for  edge  e^  in  a  tree  with  artificial^  every  change  in 
variables  in  step  3  causes  x^  to  increase  if  e^  is  an  even  edge  and 
to  decrease  if  ek  is  an  odd  edge. 

The  primal -dual  method  explained  for  network  flows  in  Chapter  I, 
section  6,  applies  here  in  exactly  the  same  way,  except  that  the  matrix 
A  is  different,  and  7 ^  -  7T  is  replaced  by  7^  -<•  for  this  problem. 
$.  Integer  Programming  in  an  Undirected  Graph 

The  integer  programming  problem  considered  in  this  section  is: 


CU)  Ax  +  Us  +  Iy  =  b,0£x£a,0£s£a,0£y,x  and  s 

n 

Z  y  =  w(min)  integer, 

ial  1 

where  A  and  U  are  the  same  as  in  the  previous  section,  and  b  0  , 
a  >  0  ,  and  a  >  0  all  have  integer  components. 

By  lemma  7,  the  alternating  path  algorithm  gives  integer  answers 
to  (2)  except  around  odd  cycles  in  the  basis.  The  odd  cycles  will 
now  be  handled  so  as  to  avoid  non-integer  solutions. 

The  idea  of  the  algorithm  is  the  familiar  cutting  plane  method 
used  by  Dantzig,  Fulkerson,  and  Selraar  Johnson  on  the  traveling  salesman 
problem  [1  ]  and  systematically  developed  by  Gomory  £  This  algorithm 

is  similar  to  one  that  Edmonds  f  has  used  to  solve  a  special  case  of 
(2)  ,  the  degree  constrained  subgraph  problem,  which  is  discussed  in 
the  next  section. 


Inequalities  of  the  form 
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(4)  I  \  iP 

keK 

can  be  thought  of  as  being  adjoined  to  the  system.  The  inequalities  (4) 
are  such  that  every  integer  solution  to  (f)  satisfies  them,  but  non¬ 
integer  answers  which  might  arise  in  the  alternating  path  algorithm 
do  not  satisfy  them.  The  following  lemma  tells  exactly  the  type  of 
inequalities  which  will  be  used. 

Lemma  13  Let  V  be  a  subset  of  the  vertices  of  G  and  E  be  a  subset 
of  the  edges  of  G  such  that  every  edge  of  E^  is  incident  to  at  least 
one  vertex  of  VQ  .  Suppose  that  for  all  v^e  VQ  neither  s*  nor 
s”  exists.  Let  K  «  (k  |  ek  e  EQ) ,  L  -  {k  |  e^  €  Eq  and  only  one  vertex 
of  e,  is  in  V  )  ,  M  =*  {k  |  e  e  E  and  both  vertices  of  e  are  in 

K  U  K  U  K 

V  } ,  and  J  =  { i  I  v  e  V  } .  Suppose  Zb  +  Z  a  =  2  S  +  1  where 
0  i  0  1  k€L  k 

S  is  a  positive  integer.  Then,  every  integer  solution  to  the  system  (3) 
satisfies  the  inequality  Z  \  £  P  . 

v  K 


Proof:  Let  x,  s,  be  a-  ^..oeger  solution  to  Ax  +  Us 

0£x£a,  0  £  s  £  a  ,  0  £  y  .  Summing  the  rows  i 

Iy  **  b  for  i  €  J  gives 


ke  M  ke  L  ie  J 

because  there  are  no  slacks  in  row  i  for  i  e  J  ,  and 

omitted  are  y^  and  x^  ,  k  ^  K  ,  and  for  them 

Adding  Z  x^  to  both  sides  of  (J)  gives 
keL 


+  iy  »  b  , 
of  Ax  +  Us  + 


the  only  variables 
£  0  and  y  ^  0. 


2  ( 


k€M  keL 


(6) 


or 


From  x^  £  ot^  and  K  =  LUM  follows 

(7)  2  I\ilbi+  ' 

keK  ic  J  keL 

(8)  I\  i  P  +  l  • 

k€K 

Jut,  the  left-hand  side  of  (3)  is  an  integer  so  the  right-hand  side  , 

P  +  ,  can  be  lowered  to  the  next  smaller  integer,  p  ,  and  the  proof  is 

completed. 

Since  for  a  given  graph  G  there  are  only  a  finite  number  of 
inequalities  (k)  of  the  type  given  in  lemma  8,  the  system  with  them 
adjoined  is  still  finite.  That  such  inequalities  are  sufficient  to 
give  integer  answers  to  ($)  is  proven  constructively  by  the  algorithm. 

Values  of  x  ,  s  ,  artificials  y  ,  and  dual  variables  p  will 
be  kept  track  of  throughout  the  algorithm  and  proven  optimal  at  the 
conclusion.  However,  the  algorithm  differs  from  the  previous  ones  in 
that  x,  y,  s  may  not  form  a  basic  solution.  The  inequalities  (V) 
are  not  kept  track  of  during  the  algorithm,  but  at  the  conclusion  such 
inequalities  are  formed  to  prove  optimality.  Only  the  phase  I 
procedure  will  be  done;  that  is,  the  problem  of  minimizing  w  =  Z  y^  . 

The  algorithm  is  similar  to  the  alternating  path  algorithm  of  the  preceeding 
section. 

Vertex-clusters  will  be  used  in  the  algorithm.  A  vertex-cluster 
is  a  set  of  vertices  and  other  vertex-clusters  together  with  a  set 

of  edges.  If  the  vertex-clusters  in  are  thought  of  as 
single  vertices,  then  the  form  a  graph  with  one  cycle. 


Such  graphs  were  discussed  in  section  i.  The  set  VQ  will  be  s  set 
of  certain  of  the  vertices  of  G  Included  in  soae  vertex-cluster,  and 
^  will  be  a  set  of  certain  edges  incident  to  at  least  one  vertex  of 

T0- 

The  vertex-clusters  are  nested;  that  is,  some  of  them  are  included 
in  others.  This  order  of  inclusion  is  important  in  the  variable 
change  step  of  the  algorithm.  There,  the  maximal  vertex  clusters 
are  first  thought  of  as  single  vertices  in  order  to  determine  certain 
variable  changes,  and  then  the  variable  changes  are  determined  within 
each  vertex-duster  involved  beginning  with  the  largest  and  working 
down  until  the  vertex-dueters  consist  only  of  vertices  of  G. 

If  the  maximal  vertex-dusters  are  thought  of  as  single  vertices, 
than  they,  together  with  vertices  and  edges,  font  trees  rooted  at 
vertices  or  vertex-clusters  with  an  artificial.  Let  F  denote  the 
resulting  forest.  The  forest  F  does  not  Include  any  vertices, 
vertex-dusters,  or  edges  within  the  vertex-dusters,  and  the  maximal 
vertex-du stere  are  considered  to  be  vertices  of  7  •  As  before,  the 
even  edges  in  F  are  designated  as  increasing  edges  and  the  odd 
edges  in  F  as  decreasing  edges. 

To  begin,  set  yi  •  b^  if  b^  >  0  ,  and  the  forest  F  consists 
of  vertices  with  b±  >  0  .  There  are  no  vertex-dusters  ,  ^  .  VQ 
is  empty,  and  SQ  is  empty.  ^ 

Integer  Alternating  Path  Algorithm 

Step  1:  The  dual  variables  pi  are  zero  for  vertices  not  in  the  forest 
7  of  trees  with  artificials  at  the  root.  In  the  forest  F  ,  p±  -  +1  for 
an  even  vertex,  and  «  -1  for  v^  an  odd  vertex.  The  vertices 
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v  in  U  for  all  vertex-clusters  have  p  ■  +1  ,  and  the  edge  set 

1  K  X 

has  an  associated  dual  variable  p  *  -2  . 

0  m+1 

Let  Vx  -  (i  |  pt  -  +D  »  v2  -  (i  |  Pl  -  0)  ,  V  -  (i  |  Pl  -  -1}  . 

Step  2(i) :  Search  for  an  edge  e^  or  vertex  v.^  satisfying  one  of  the 

following : 

(a)  'i  =  CV  vj3  -  *1  <  ai  ’  V1  €V1  >  “d  vj  e  V2  ; 

(b)  =  [v1,  vj]  ,  >  0  ,  cV5  ,  and  e  V?  ; 

(c)  c£  =  [v1,  v  ]  ,  x^  =  ,  v1  cVQ  ,  and  e  ; 

(d)  vi  e  VQ  ,  and  s*  or  s’  exists  ; 

(e)  v±  e  Vi  ,  vt  4  VQ  ,  and  s *  <  c*  or  s’  >  0  ; 

(f )  v4  €  ,  and  s*  >  0  or  si  <  oi  ; 

(g)  e£  =  [vt,  ,  x£  <  ^  E0  »  vi  €  V1#  and  e  ^  ; 

(h)  e£  -  [vi,  v^  ,  >  0  ,  V;L  e  ,  and  Vj  G  ; 

(I)  -  tv  V  ’  *e  ■  V  W  and  V  v5  ; 

(J)  ei  -  t\,  vj3  ,  0  <  xf  <  a£  ,  vt  e  V0  ,  and  Vj  =  . 

In  cases  (a)  -  (c)  ,  go  to  step  2(ii).  In  cases  (d)  -  (j)  ,  go  to 

step  J. 

Step  2(ii) :  In  case  (a),  if  x^  a  0  or  if  v^  ^  VQ  ,  then  change 

v  from  V  to  V  ;  adjoin  e  and  v  to  F  ,  and  return  to 
J  2  5  x,  j 

step  2(i).  If  >  0  and  v^  c  VQ  ,  then  let  U^,  be  the  largest 

vertex-cluster  containing  v  .  Let  v .  e  U  ,  v .  e  V  ,  change  v 

^  J  -L  J  ^  j 

from  Vg  to  V1  ,  put  in  ,  and  put  every  edge  e  =  [v  ,  v] 

for  v  €  U  H  VQ  in  the  edge  set  Eq  .  Return  to  step  2(i). 


In  case  (b),  change  Vj  from  to  ,  adjoin  e^ 


and 


v  to  F  ,  and  return  to  step  2(i). 
J 


In  case  (c),  let  U  ,  E^  be  the  largest  vertex-cluster  containing 

v  .  Change  v  from  Vr  to  V  ,  put  v  in  U  ,  e  in  E  , 

i  J  <j  1  £  1 

and  cB  in  E  .  Return  to  step  2(i). 

Ju  0 

Step  3:  In  case  (d),  let  t^,  E  be  the  largest  vertex-cluster 
cont&ihing  ,  let  v  be  the  root  of  the  tree  in  F  containing 
,  and  let  P  a  (v^,  e  ,  , . . . , v^  e ^  U^)  be  the  path  in  F 

from  v^  to  U  . 

In  cases  (e)  and  (f),  let  v^  be  the  root  of  the  tree  containing 
v±  and  let  P  =  (v  ,  e^  v2>‘**>vi  i>  e1  i>  Vj_)  be  the  Path  in  F 
from  v^  to  v  . 


In 


cases  (g)  -  (j)  ,  suppose  v  and  v  are  in  different 

1  J 


trees  of  F  .  Let  v^  be  the  root  of  the  tree  containing  v  , 

let  v  be  the  root  of  the  tree  containing  v .  ,  let  (v  ,  e  ,  v  , . . . , 

X*  J  X  X  t 

vi  1’  *i  1’  Vi^  be  the  path  in  F  from  vi  vi  >  and  let 

(vJ(  e.,  v  ,  e  , ,  v  )  be  the  path  in  F  from  v  to 

v  j  J  J+l  ’  r-x  r-1'  r  j 

v  .  Let  P  =  (v.,,  e  , ,  v  , ....  v. ,  e.,  v  ,  e  ,  v.  v  ).  The 

r  1  1'  2  i  l*  J  y  j+l"  r 

vertices  v,  and  v  have  yn  >  0  and  y  >  0  .  In  case  (g)  , 

1  r  1  r 

e^  is  increasing,  and  in  cases  (h)  -  (j),  e^  is  decreasing. 

In  all  of  the  above  cases,  a  positive  integer  change  0  can 
be  made  in  the  variables  corresponding  to  F  ,  just  as  in  the  alternating 
path  algorithm.  Here  it  must  also  be  shown  that  an  integer  change  ±9 
can  be  made  alternately  within  a  vertex-cluster  included  in  the  path  P. 
Lemma  1^  provides  that  proof.  Go  to  step  4. 

In  cases  (g)  -  (j)  ,  suppose  and  v^  are  in  the  same  tree  of 

F  .  Let  the  path  in  F  from  v^  to  v^  be  (v^,  e^,  vi+1> •  •  •  ejJ 

v.)  and  form  the  cycle  C  =  (v^  e^  v1+1>**  •  > ey  vy  e^)  • 
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Let  the  root  of  the  tree  containing  v  and  v  be  v  and  let  P  = 

J 

(vl>  v2,’,,,Vr-V  er-l>  vr^  be  the  path  ln  F  from  Vl  t0 

the  cycle.  If  none  of  v1,...,v  is  a  vertex-cluster,  if  all  increasing 

edges  e^  in  P  liave  x^£  -  2  ,  and  if  all  decreasing  edges  c- 

in  P  have  x^  ^  2  ;  then  a  variable  change  with  ©  =  2  can  be  made 

just  as  in  the  alternating  path  algorithm  except  that  lemma  9  is 

needed  to  show  that  a  positive  integer  change  can  be  made  through 

any  vertex-clusters  in  the  cycle.  Repeat  the  variable  change  with  ©  =  2 

until  such  a  change  would  violate  the  feasibility  conditions  0  £  x  £  a  , 

y  £  0  .  If  an  increasing  edge  e  has  x  =  a  or  a  decreasing  edge 


has  x^  =  0  ,  then  go  to  step  4. 


Otherwise,  let  v  he  the  vertex  in  P  nearest  to  v  such  that 
’  q  r 

either  v  is  a  vertex-cluster,  e  ,  is  a  decreasing  edge  with 
q  >  q-1 

x  .  a  1  ,  or  e  is  an  increasing  edge  with  x  o  a  -  1  .  A  new 
q-1  q  q  q 

vertex-cluster  ,  E^  will  be  formed.  Let  v  ,...,v^  and  all  of 

the  vertices  or  vertex-clusters  of  the  cycle  C  be  in  and  let 

e  ,...,e  ,  and  all  of  the  edges  of  the  cycle  C  be  in  E„  .  The 

q  r-1  h 

vertex  v  is  the  base  of  U,  .  Let  U,  be  in  F  and  remove  all  of 
q  h  h 

the  vertices  of  and  edges  of  from  F  .  If  e^  was  an  increasing 

edge  with  x  =  a  , .  then  let  Vn  include  v  v  and  all  of  the 

vertices  of  the  cycle  C  .  Otherwise,  let  include  all  of  the  vertices 

of  U^.  Let  Eq  include  all  of  the  edges  in  E^  and  all  of  the  edges 

with  both  vertices  in  U,  f|V  •  If  an  edge  e,  =  [v  v.]  of  F  has 

n  u  k  l  j 

v,  £  U,  .  v,  d  U,  »  0  <  x.  <  a  .  then  adjoin  e,  tc.both  E, 

1  h  '  j  *  h  k  k  k  h 

and  E  and  adjoin  the  vertex  v  to  both  U  and  V  .  Remove 
0  j  h  0 

e  and  v .  from  F  .  Enlarge  e  to  include  all  edges  e  a  [v  ,  y] 
k  j  0  j 


for 


ViG 


l)  ' 

F  . 


v  some  vertex  in 
U,  ,  v  {  IT  ,  and 
adjoin  the  vertex 


H  VQ  ,  If  an  edge  e^  =  [v^  v  ] 

x  =  a  ,  then  adjoin  e  to  both 
k  k  k 

v .  to  only  U,  ,  and  remove  e  ,  v 
J  h  '  k  '  j 


has 

E  and 
h 

from 


Return  to  step  1. 

Step  4:  For  P  =  e±,  v2> •  •  •  >  er_x>  vr)  >  if  vx  has  an 

artificial,  then  let  v  be  the  vertex  in  P  nearest  to  such  that 

'  <1  1 

either  v  is  a  vertex-cluster,  e  ,  is  a  blocking  edge,  e  , 

q  ’  q-1  ’  q-1 

is  an  entering  edge,  or  Vq  =  vr  *  f^len  drop  oil  of  P  from  e^  ^ 

to  the  entering  variable  from  F  ,  and  drop  from  F  all  of  the  vertices 

and  edges  whose  path  to  the  root  includes  vertices  already  droppea  from 

F  .  Delete  from  VQ  all  those  vertices  and  change  them  from  V  or 

V  to  V  .  Drop  all  of  the  vertex-clusters  and  drop  from  E  any 

0 

edge  incident  to  a  vertex  dropped. 

Return  to  step  1. 

LejsaJJ*  Let  ^  be  a  vertex-cluster  and  v  *  ^  .  Then,  there  Is 
an  alternating  path  P  from  v  to  the  base  of  ,  and  the  end 
edge  in  P  incident  to  v  is  a  decreasing  edge.  If  v  e  as 

well,  then  there  is  also  an  alternating  path  with  an  increasing  end 
edge  at  v  .  A  positive  integer  change  in  variables  can  be  made  along 
the  alternating  paths. 

Proof:  The  proof  is  by  induction  because  it  is  assumed  that  the 

lemma  is  true  for  every  vertex-cluster  used  in  formi  .■ ;  the  vertex-cluster 
U,  .  With  that  inductive  hypothesis,  we  can  assume  all  of  the  vertex- 

K 

clusters  used  to  form  are  single  vertices. 

Initially,  the  vertex-cluster  U,  is  formed  from  a  path 
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(Y  Y 


2* 


>'  T  >  e  i  ,  V 

'  r-17  r-17 


)  and  a  cycle  C  =  (v  ,  e  ,  v 
r  rJ  r 


,  i  •  •  •  * v  • 

r+17  7  q 


eq#  Vr^  w^ere  the  path  P  may  consist  only  of  the  vertex  v^  .  The 
cycle  C  is  an  odd  cycle  and  has  the  same  alternating  character  as  in 
the  alternating  path  algorithm. 

For  any  vertex  vt  e  C  ,  i  r  +  1  ,  P_L  «  (v^  e^  v1+1>  •  •  •  >  vq> 

e  ,  v  ,  e  ,  ,  v  ..... v^.e  ,  v  )  and  P  =  (v  ,  e.  , ,  v . 

q  r  r-1  r-1  2  11  2  i  i-17  i-1 

v  .  e  ,  v  ,  e  .v  , ... ..v,.  e, ,  v,  )  are  alternating  paths  from 
r+1  r  r  r-1  r-1'  7  27  l7  1 

v  to  v^  ,  and  one  of  e^,  is  increasing  while  the  other  is 

decreasing.  The  paths  P  and  P^  are  simple  paths  so  obviously 
an  integer  change  can  be  made. 

For  any  vertex  v±  €  P  ,  i  £  2  ,  P1  -  (v±,  e^,  Yl7’"^7  «1, 


and  P„  3  (v^  e^  v^  ,v^  , ,  vw,  e  ,  v 


j  •  •  •  •  V  j  C  ^  V  ^  c  -  j 

7  7  n*  n'  r-1 


2  N'i'  'i'  i+17”*7  r-17  r-1'  r7  r7  r+1 - q'  q'  r 

vr  e^,  v  )  are  alternating  paths  from  v^  to  v^  ,  and  one 

of  e^,  e^  ^  is  increasing  while  the  other  is  decreasing.  The  path  P^ 

is  simple, but  Pg  is  not  simple.  But,  the  increasing  edges  e^  of 

P  ,  k  ^  2  ,  have  £  0^  -2,  and  the  decreasing  edges  e^  of  P  have 

J>  2  ,  Hence,  an  integer  change  can  still  be  made  along  P^  and  P^  . 

For  v^,  the  path  P^  =  (v^)  has  the  effect  of  having  the  end 

edge  an  increasing  edge  because  at  v^  there  is  either  an  artificial 

or  a  decreasing  edge  incident  to  v^  on  the  path  leading  from  v^ 

to  the  root.  If  v  €  V  ,  then  all  of  the  increasing  edges  e  of 

-L  U  K 

P  have  Xj^  Ot^  •• 2  ,  and  decreasing  edges  e^  of  P  have  x^  ^  2. 

Hence,  Pg  =■  (vJL<  e^  e^,  vr,  er,  V  V  'r-1’ 

v  Y  Vl^  is  an  alternating  path  from  v^  to  v^  with  e^ 

decreasing  and  permitting  an  integer  change  in  variables.  The  proof  is 


complete. 
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The  change  of  variables  in  step  3  is  now  complete.  Finiteneos  will 
now  be  proven. 

m 

Theorem  1_  If  M  ■  2  b  ,  then  the  algorithm  terminates  in  at  most 

i*tl 

2  m  M  iterations. 

Proof:  Every  change  of  variable  in  step  3  results  in  an  integer 

m 

decrease  in  2  y  .  Hence,  the  proof  will  be  completed  if  it  is 
i*L  1 

shown  that  there  can  be,  at  most,  2  m  iterations  in  sequence  with  no 
change  in  flow. 

If  the  algorithm  goes  to  step  2(ii),  then  decreases  by  one 
vertex,  and  VQ  either  remains  the  same  or  increases.  If  the  algorithm 
goes  to  step  3  and  no  change  in  variables  results,  then  a  new  vertex- 
cluster  is  formed^and  VQ  increases  by  at  least  one  vertex  while 
Vg  remains  the  same.  There  are  only  m  vertices  in  all,  so  only  2  m 
such  iterations  could  occur  in  sequence. 

Theorem  8  At  the  termination  of  the  algorithm,  let  J  ,  K  ,  L  ,  and 
M  be  as  in  lemma  13  and  let  q  be  the  number  of  vertex-clusters  in 
F  ;  that  is,  the  number  of  maximal  vertex-clusters.  Then, 

(9)  Z\ +  Iak-2e  +  '1 

ie  J  keL 

where  3  is  a  positive  integer,  every  integer  solution  to  (3)  satisfies 

2  x.  £  3  ,  and  the  present  solution  x  ,  s  ,  y  is  optimal  to  the 

kcK  K 

linear  program: 

(H}  Ax  +  Us  +  Iy  =  b  ,  0  £  x  £  a  ,0£s£a  ,  0  £  y  , 

y  x  ^  p 

L  k  m 

k€K  )  y±  -  v(min)  . 

ii 


Proof:  Equation  (9)  and  the  fact  that  every  integer  solution  to  (3) 


satisfies  2  * .  £  S  will  be  shown  together.  Suppose  that  the 
kcK  K  " 

maximal  vertex-clusters  are  (U. ,  E ),,,. ,  (U  ,  E  )  .  Let  ■  V  0  U 

1  1  q  q  0  0  i, 

and  E^  ■  EQ  A  E^  .  Let  V?  a  (k  |  ek  €  E^)  ,  ■  {k  |  efc  e  and 

only  one  vertex  if  e^  is  in  $  ,  >  {k  |  ek  e  E*  and  both 

,  and  a  (i 

For  each  &  *  l,...,q  , 


vie 


$ 


vertices  of 


are  in 


* 


(IX) 


1 


because  at  the  base  of  each  vertex  cluster  either  there  is  an  edge  e^  , 
k  €  ,  with  x^  *  0!^  -  1  ,  or  there  is  an  edge  e^  ,  k  {  ,  with 

3^  ■  1  .  All  other  edges  e^  f  k  ^  ,  incident  to  vertices  of 

have  x^  a  0  .  There  are  no  slacks  on  v^  €  VQ  because  of  step  2(i) 

l 

case  (d).  Hence,  2  ,b  +  2  jcl  is  an  odd  number  ;  say,  2$  +  l  . 

i€«r  1  keL£  * 

Then,  lemma  13  asserts  that  every  integer  solution  to  (£)  satisfies 
(1*) 


k€K 

fhe  vertex  sets  are  pair-wise  disjoint,  and  the  edge 

sets  Eq,...,Eq  are  pair-wise  disjoint.  Summing  the  equations 

2  «b.  +  2  .cr  =  20  +1  for  ,gal,...,q  gives  2  b  +  2  0£  ■  2p  +  q, 
i€«T  1  k€L  K  i€J  1  kcL  K 


where  p  a  2  p 
4al 

Thus,  equation  (9)  is  proven,  and  summing  the  inequalities  (l<) 

for  i  a  l,...,q  ,  gives  2  x  ^p  for  every  integer  solution  to  (3). 

keK  K 
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To  prove  optimality,  the  complimentary  Blackness  conditions 
(page  134,2;$)  will  be  used  since  the  solution  is  no  longer  basic. 
The  dual  variables  are  pj^  ■  +1  for  ■  0  for 

vi  €  V2  *  P1  *  for  vi  €  Pm+1  "  “2  •  following 
conditions  together  with  complimentary  slackness  prove  optimality: 


(13) 

if 

e,  € 

K 

Eo  ' 

ek 

■  [V  vj 

)  ,  then  Pt  +  Pj  +  Pm+1  - 

0  ; 

(14) 

if 

V 

*k 

*  [v  vj 

]  >  ^  **  \>  then  +  Pj 

(15) 

if 

Eo  ' 

ek 

■  [v  vj 

]  >  0  <  \  <  V  then  Pi  + 

PJ  = 

(16) 

if 

V 

ek 

*  [v  vj 

]  >  \  ■  0  ,  then  Pl  +  Pj 

1° ; 

(IT) 

if 

+ 

8i  1 

aaI 

or 

s‘  »  °  , 

then  p  ^  0  ; 

(18) 

if 

0  < 

si  < 

+ 

ai 

or  0  < 

s-<a-,  then  pi  =  0  . 

(19) 

if 

+ 

si  ■ 

=  0 

or 

3i  ■  °i  ' 

then  £  0  . 

(SO) 

Z 

,*k  = 

w 

0  . 

kc* 

Condition  (13)  follows  from  the  observation  that  if  ek  e  Eq  ,  then 


vi £  vi  and  vj £  vi  • 


If  (14)  were  violated,  then  either  v ^  e  and  Vj  c  ,  or 

v.  €  V  and  v  e  V  .  But  the  algorithm  has  terminated,  and  step  2(i) 

15J3 

case  (b)  excludes  v.  e  V  and  v  €  V  ,  and  case  (h)  excludes 

X  J  t 


v.  €  V  and  v  c  V  . 
i3  j  3 


Similarly  for  (l$),  step  2(i)  case  (a)  excludes  v^^  €  and 

v  £  V  ,  case  (b)  excludes  v  €  V  and  v  e  V  ,  case  (g)  excludes 
J  2  13  J  2 

Vj  €  V,  and  v.  c  V,  ,  and  case  (h)  excludes  v.  €  V  and  v  c  V  . 
il  J  1  i  3  J  3 

Hence,  either  p±  e  ^  and  ,  or  p^  e  Vg  and  Pj  e  Vg  .  In 

either  case,  +  pj  a  0. 

For  (l 6),  step  2(i)  case  (a)  excludes  and  v^  e  , 

and  case  (g)  excludes  v^  e  and  e  V^.  Hence,  Pi  +  pj  £  0  . 
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In  (IT),  step  2(i)  case  (f)  assures  that  v  ^  V  so  p  >  0  . 
In  (l8),  step  2(i)  cases  (e),  and  (f)  assure  that  and 


PjL  -  0. 


In  (l9),  step  2(i)  cases  (d)  and  (e)  assure  that  vi  4  V  and 
Pi  1  0  • 

0 

Equation  (li)  proves  that  Z^x^  3  ^  »  and  summing  for  £  =  l,,..,q 

gives  (20). 

Corollary  1  If  G  has  no  odd  cycles  or  if  every  odd  cycle  in  G  has 
at  least  one  vertex  with  a  slack  permitted,  then  no  vertex  clusters 
need  be  formed  and  no  inequalities  need  be  adjoined  to  the  linear 
program  (5)  in  order  to  find  an  integer  answer. 

Proof:  The  proof  follows  from  the  fact  that  VQ  has  no  slacks  at  any 

of  its  vertices. 

Corollary  2  An  integer  solution  x  ,  s  ,  y  to  (JO  is  optimal  if, 
and  only  if,  there  does  not  exist  an  alternating  path  P  in  G 
with  an  artificial  >  0  at  one  end  and  an  increasing  edge  at  that 
end  of  P  ,  and  the  other  end  of  P  having  a  slack  or  artificial 
which  can  change  to  compensate  for  the  change  in  the  other  end  edge 
of  P  ,  The  path  P  need  not  be  simple, 

J2t_  The  Degree -Constrained  Subgraph  Problem 

The  degree  p(v)  of  a  vertex  v  of  a  graph  G  is  the  number 
of  edges  incident  to  v  ,  Let  H  be  a  subgraph  of  G  and  let  the 
degree  of  a  vertex  v  in  H  be  denoted  p'(v).  The  integer  program 
in  an  undirected  graph  of  the  preceeding  section  can  be  interpreted  as 
the  following  problem:  if  an  edge  e^  can  be  repeated  0^  times  in 
determining  the  degrees  p’(v)  of  vertices  v  in  H  ,  then  rind,  if 
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possible,  a  subgraph  H  of  G  such  that  b  <  p'(v  )  <  b,  +  a"  if  s“ 
exists,  b1  -  £  b^.  if  s*  exists,  and  b^  ■  p'^)  if 

no  slack  is  permitted  at  .  Here,  if  ®  +  «  ,  then  there  is  no 
upper  bound  on  p'(v^)  ,  and  if  a*  »  +  co  ,  then  there  is  no  lower  bound 
on  p'Cv^)  ,  although  zero  is  always  an  implied  lower  bound  on  v  . 

This  problem  has  been  studied  by  Berge  [l],  Norman  and  Rabin  [y  ], 
and  Edmonds  U]  and  [50. 

Corollary  5  (Berge,  Norman,  Rabin)  Among  all  subgraphs  H  of  G 
having  p '  (v^ )  £  b^  ,  a  given  subgraph  HQ  has  the  maximum  number 
of  edges  if,  and  only  if,  there  is  no  alternating  path  between 
two  vertices  v^  and  H0  suc^  that  p'(v^)  <  b^  ,  p'Cv^)  <  b^  , 

and  the  alternating  path  has  increasing  edges  at  each  end. 

Proof:  This  corollary  follows  from  corollary  2  applied  to  the 

following  special  case  of  (9): 

(21)  Ax  +  Iy  =  b  ,  O^x^ci^,  0  £  y  ,  x  integer 

m 

Yjyits  w(|aln)  • 

i=l 

ra 

Subtracting  the  rows  of  Ax  +  Iy  =  b  from  the  objective  2  y.  and 

1=1 

dividing  by  -2  converts  (0L)  into 

(2E)  Ax  +  Iy  =*  b  ,  0  £  x  £  o ^  ,  0  ,  x  integer, 

n 

a  z(max)  . 

k«l 
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